-- Logs begin at Wed 2022-05-04 07:31:38 UTC, end at Wed 2022-05-04 08:30:52 UTC. -- May 04 08:01:16.843408 dv-cinder-840289-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 08:01:16.852797 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 08:01:16 2022] *** May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: nodename: dv-cinder-840289-4-iscsi May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: machine: x86_64 May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: clock source: unix May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: pcre jit disabled May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: detected number of CPU cores: 4 May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: current working directory: / May 04 08:01:16.854745 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: detected binary path: /usr/bin/uwsgi-core May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: your processes number limit is 47680 May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: your memory page size is 4096 bytes May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: detected max file descriptor number: 2048 May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: lock engine: pthread robust mutexes May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: thunder lock: enabled May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 08:01:16.855323 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 08:01:16.899831 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: Python main interpreter initialized at 0x5575ecb569c0 May 04 08:01:16.899831 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: python threads support enabled May 04 08:01:16.899831 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: your server socket listen backlog is limited to 100 connections May 04 08:01:16.899831 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: your mercy for graceful operations on workers is 90 seconds May 04 08:01:16.900227 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: mapped 403077 bytes (393 KB) for 2 cores May 04 08:01:16.900332 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: *** Operational MODE: preforking *** May 04 08:01:16.900647 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: *** uWSGI is running in multiple interpreter mode *** May 04 08:01:16.900647 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: spawned uWSGI master process (pid: 80086) May 04 08:01:16.900867 dv-cinder-840289-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 08:01:16.902841 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: spawned uWSGI worker 1 (pid: 80097, cores: 1) May 04 08:01:16.902841 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: spawned uWSGI worker 2 (pid: 80098, cores: 1) May 04 08:01:16.902841 dv-cinder-840289-4-iscsi devstack@keystone.service[80086]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 08:01:22.591915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 08:01:22.591915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: from cryptography.utils import int_from_bytes May 04 08:01:22.592703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 08:01:22.592703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: from cryptography.utils import int_from_bytes May 04 08:01:22.594963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 08:01:22.594963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: from cryptography.utils import int_from_bytes May 04 08:01:22.595439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 08:01:22.595439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: from cryptography.utils import int_from_bytes May 04 08:01:22.641190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 08:01:22.641349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 08:01:22.641558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] command line args: [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 08:01:22.641800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 08:01:22.641910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 08:01:22.641990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ================================================================================ {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 08:01:22.642052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 08:01:22.642236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] command line args: [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 08:01:22.642316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] admin_token = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.642384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] config_dir = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.642447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 08:01:22.642691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ================================================================================ {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 08:01:22.642781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.642848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] config_source = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.643035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] admin_token = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.643108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] debug = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.643179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] config_dir = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.643238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] config_source = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] debug = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.645966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_config_append = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_dir = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_file = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_config_append = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.646831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_dir = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.647424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.647650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_file = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.647811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.648001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.648224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.648388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.648580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.648580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.648961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.649147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.649372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.649372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.649719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.649911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.650109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.650302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.650488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.650673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.650867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.651098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.651258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.651453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.651638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.651830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.652895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] publish_errors = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] publish_errors = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.653965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.654095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.654219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.654410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.654551 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] standard_threads = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.654679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.654835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] standard_threads = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] use_journal = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.655937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] use_json = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] use_stderr = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] use_syslog = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] use_journal = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] use_json = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.656845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] use_stderr = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.657092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.657221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] use_syslog = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.657345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.657545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 08:01:22.657676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.657800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.657929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.658970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.659941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.660967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.661971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.662852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.663928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.664951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.665923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.666972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.667994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.668881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.669004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.669139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.670317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.670485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.670683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.670868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.671090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.671316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.671483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.671671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.671855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.672096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.672254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.672254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.672621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.672869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.672869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.673223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.673407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.673632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.673793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.674055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.674247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.674434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.674666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.674860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.675050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.675246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.675404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.675544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.675703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.675842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.676948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.677975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.678942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.679896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.680987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.681983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.682991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683211 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.external = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.password = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.683932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] auth.token = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.external = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.684996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.password = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] auth.token = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.685950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.686488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.687562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.688855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.689915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.690976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.691927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.692882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.693737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.694924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.695948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.696904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.697953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.698999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.699925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700154 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.700971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.701972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.702913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.703985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.704917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.705916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.706831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.707945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.708912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.709960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] role.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] role.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.710873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.711987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.712901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.713939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.714861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.715933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716070 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.716974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.717886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] role.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.718959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] role.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.719896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.720870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.721971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.722938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.723211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.723357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.723492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.723626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.723759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.723893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.connection = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.724857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.725956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.726964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.727924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.728881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.729422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.connection = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.730545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.731703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.732766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.732766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.732766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.732766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.732766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.733387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.733387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.733387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 08:01:22.733761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 08:01:22.756476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.756726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.756905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.759913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.760142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.760363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.765497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.768954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.793407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.793653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.794826 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.795094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.847310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.847678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.899201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.899437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.899592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.899824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.964426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.964600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.964670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.964750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.964849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.964949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.965032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.965191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.965319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.965416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.965496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.965651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.988338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.988558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.988677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.988768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.988863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.988969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:22.989872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.000746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.001260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.015350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.015563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.015765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.015860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.015953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.016797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.017004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80097) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 08:01:23.033717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.033917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 08:01:23.034105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.034241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.034343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 08:01:23.034423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 08:01:23.034625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.034707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.034820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 08:01:23.034944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.035108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.035192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.035363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.035444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.035614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.035862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.046166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.046432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.046690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.046777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.046984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.047098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.047307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.047575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.055019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.055687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.058256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.058525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.058796 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.058959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.059207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.059313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.059479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.059562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.059727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.059866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.059979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.060932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.061014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.061195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.061459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.061718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.087670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.088533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.089269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.089540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.090149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.090425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.094767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.095058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.095328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.095782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.096057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.096336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.102640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.102921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.103672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.103948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.107566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.107844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.108116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.108388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.108558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.108657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.108841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.108927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.109117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.109197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.109387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.109469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.109648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.109911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.110169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.110430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.127859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.128120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.128976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.130633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.132601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.133731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.136169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.136454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.137336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.137624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.141335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.142641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.144945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.146194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.148674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.148878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.149175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.149444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.149707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.149918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.150129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.150217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.150469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.150747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.151047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.151321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.168783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.169145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.169404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.169657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.170191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.170559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.170856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.171109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.177533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.178992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.179279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.179545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.180687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.180942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.182559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.182829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.183128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.183397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.183660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.184001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.184275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.184552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.184828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.185081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.197249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.197519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.197785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.198057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.198324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.198586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.198729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.198817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.199057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.199334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.199647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.199887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.200147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.200412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.216857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.218374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.220035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.221683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.223346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.224914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.225040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.226512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.226680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.226769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.227076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.228177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.228449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.228721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.234379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.235985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.236112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.237748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.239241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.239523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.239804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.240069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.240970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.241254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.241533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.241800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.249133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.249419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.249686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.251121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.251420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.251695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.257865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.258137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.258403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.258666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.258918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.259219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.259488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.259614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80097) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 08:01:23.259718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.259883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.260975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.261056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.261204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.261331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.261469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.261714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.262000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.262261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.262514 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.262769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.263064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80097) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 08:01:23.299489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5575ecb569c0 pid: 80098 (default app) May 04 08:01:23.301441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5575ecb569c0 pid: 80097 (default app) May 04 08:01:23.302931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e5c1-6a43-4a0d-ac64-2951791b9249 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:23.303200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e5c1-6a43-4a0d-ac64-2951791b9249 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:23.303471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342e5c1-6a43-4a0d-ac64-2951791b9249 None None] PATH_INFO: `/v3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:23.307604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Wed May 4 08:01:23 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:31.352572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79686bb8-51eb-44e7-9d6c-4b3de8010360 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:31.353161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79686bb8-51eb-44e7-9d6c-4b3de8010360 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:31.353161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79686bb8-51eb-44e7-9d6c-4b3de8010360 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:31.357407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:31.362863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:31.363299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:31.363491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:31.395206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG oslo_db.sqlalchemy.engines [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 08:01:31.587009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG passlib.handlers.bcrypt [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80098) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 08:01:31.587449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG passlib.handlers.bcrypt [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80098) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 08:01:31.642150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:31.643889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:31.771971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 08:01:31.916869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79686bb8-51eb-44e7-9d6c-4b3de8010360 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:31.952391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG oslo_db.sqlalchemy.engines [None req-79686bb8-51eb-44e7-9d6c-4b3de8010360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 08:01:32.077164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79686bb8-51eb-44e7-9d6c-4b3de8010360 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:32.082014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:32.082676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:32.082983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:32.083254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:32.091524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:32.142031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 08:01:32.142400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e51df5-c751-43a2-bbbb-da77655540c7 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:32.151953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Wed May 4 08:01:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:01:32.158139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:32.172538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700bc79-980f-4d22-b4a5-d49ff68e4dd7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:32.177412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:32.178537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:32.178813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:32.179117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] PATH_INFO: `/v3/projects/464080567f3f4194af284b80faf51856` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:32.180641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] RBAC: Authorizing `identity:get_project(project_id=464080567f3f4194af284b80faf51856)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:32.230233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 08:01:32.230564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c042d-764f-4b68-9f9c-752a4e235b91 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:32.235039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Wed May 4 08:01:32 2022] GET /identity/v3/projects/464080567f3f4194af284b80faf51856 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:34.407858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163443-9d74-4923-ab00-4b68abc130fe None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:34.408308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163443-9d74-4923-ab00-4b68abc130fe None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:34.408399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f163443-9d74-4923-ab00-4b68abc130fe None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:34.412519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:01:34.418212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:34.418638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:34.418738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:34.439424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:34.440917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:34.449891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 08:01:34.472665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163443-9d74-4923-ab00-4b68abc130fe None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:34.492247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f163443-9d74-4923-ab00-4b68abc130fe None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:34.498202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13937f-f2ab-443c-bbd0-b8e0f2260a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:34.498837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13937f-f2ab-443c-bbd0-b8e0f2260a18 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:34.499151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13937f-f2ab-443c-bbd0-b8e0f2260a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:34.499423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13937f-f2ab-443c-bbd0-b8e0f2260a18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:34.508111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13937f-f2ab-443c-bbd0-b8e0f2260a18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:34.509905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13937f-f2ab-443c-bbd0-b8e0f2260a18 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:34.519496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Wed May 4 08:01:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:01:34.528091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:34.542517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea278c-f3f0-4f89-9072-75de798de1f4 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:34.550585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc39d9-6cf0-4732-a3fe-cd7eab85b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:34.551483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc39d9-6cf0-4732-a3fe-cd7eab85b401 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:34.551754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc39d9-6cf0-4732-a3fe-cd7eab85b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:34.552028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc39d9-6cf0-4732-a3fe-cd7eab85b401 admin admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:34.553622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc39d9-6cf0-4732-a3fe-cd7eab85b401 admin admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:34.555480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc39d9-6cf0-4732-a3fe-cd7eab85b401 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:34.557016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Wed May 4 08:01:34 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:36.828700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2a01-bb1d-41bb-90b1-c36e8d4fbb37 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:36.829205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2a01-bb1d-41bb-90b1-c36e8d4fbb37 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:36.829205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2a01-bb1d-41bb-90b1-c36e8d4fbb37 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:36.830505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:36.835875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:36.836284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:36.836449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:36.868593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae29e0f-6022-4224-8f21-92314fe86f4c None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:36.868878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae29e0f-6022-4224-8f21-92314fe86f4c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:36.869153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae29e0f-6022-4224-8f21-92314fe86f4c None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:36.870518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:01:36.876730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:36.877009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:36.877283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:36.918921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG passlib.handlers.bcrypt [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80097) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 08:01:36.919360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG passlib.handlers.bcrypt [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80097) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 08:01:36.964090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:36.965264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:36.965898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:36.967503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:37.044820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:37.066405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:01:37.068248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.088802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.164223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48a2ee-677b-4d82-bd7c-38d797dee2cc None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.185221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e51383-937e-48d7-a5db-ee735f4efa72 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.198651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.199487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.199770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.200037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.211586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:37.217017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.217985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.218328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.218660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:37.222663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:37.223712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:01:37.224524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:37.229694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.288319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.290636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.341026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d175cd2-8afb-4d87-8e85-0b9659aabcb2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.374447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.375136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.375420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.375704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.376529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:37.376790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.378201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.390199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:01:37.392256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:01:37.395784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.397836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.493117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127959c9-9dcd-46ff-a004-1187e51da661 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.495209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b495bf-0294-4cea-9ab4-d3c88168fcf7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.527822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.528268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9628-4555-4837-9054-9231662d8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.528611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.528885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.529145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9628-4555-4837-9054-9231662d8720 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.529231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.529431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9628-4555-4837-9054-9231662d8720 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.529706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9628-4555-4837-9054-9231662d8720 None admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.531085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9628-4555-4837-9054-9231662d8720 None admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.532559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9628-4555-4837-9054-9231662d8720 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.534292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:01:37.539849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9628-4555-4837-9054-9231662d8720 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.661106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9628-4555-4837-9054-9231662d8720 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.662750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.664243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:01:37.685021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:37.685903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:37.686724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:01:37.686724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:01:37.686724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:01:37.686724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:37.686724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:37.692075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.697328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.698133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.698416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.698688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.700000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.701431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.703057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:37.708738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:37.790169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7c471-594b-4d5a-9ead-7b1b06f17234 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.801354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047e50-b5d9-45e8-b314-4ef9428684bb None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:37.823856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.824510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.824790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.825076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.825794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:37.826096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.827519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea45d8-c947-4048-8d2d-190ad01faae5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.834311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:37.834981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:37.835259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:37.835526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:37.836343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.domain.id=default, user.id=9f5e493603104e09ac10fad9a8d68de4) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:37.836885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:37.838041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547449d-74bd-4352-a234-0c462c73056f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:37.844429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:01:37.844970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Wed May 4 08:01:37 2022] GET /identity/v3/role_assignments?user.id=9f5e493603104e09ac10fad9a8d68de4&scope.domain.id=default&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:40.314710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0189c-9c4d-42be-a890-e08294461b75 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.314710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0189c-9c4d-42be-a890-e08294461b75 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.314710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0189c-9c4d-42be-a890-e08294461b75 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.315658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:40.320520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.320960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.321235 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.344633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:40.345891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:40.375906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b80a1-ffcf-44b5-86e0-a45579bf15e8 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.376592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b80a1-ffcf-44b5-86e0-a45579bf15e8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.377146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b80a1-ffcf-44b5-86e0-a45579bf15e8 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.378933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 12/23] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:40.384380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.384982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.385577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.406862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:40.408502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:40.425101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 12/24] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:40.459472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:40.513589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:01:40.556439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:40.597280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ba41-3b5f-48ef-87ef-b09ca25a7e1a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:40.643730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:40.644861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.645283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.645693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.664028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:40.676143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:40.677023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:40.677805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:01:40.680213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 13/26] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:40.686153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:40.710173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf341e-a00f-4d80-98d2-1e6c96f4280f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:40.789064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:40.789897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.790175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.790445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.813031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:40.814598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:40.837225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854c4f3-d5d4-409c-b7b0-7ca2164e8cfa None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:01:40.855345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:40.856380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:40.857266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:01:40.857266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:01:40.857266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:01:40.857266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:40.857266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 14/27] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:01:40.862691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:40.887592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:40.888515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:40.889039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:40.889448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:40.890346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:40.890794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:40.892395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:40.901678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 14/28] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:40.912002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:41.073630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9c0ae-914a-4936-a7d9-27164254adaa None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:41.092906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2909a4-08c9-4d7c-befc-440e4fe0ef8b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:41.128801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:41.129389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.129671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.129945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.130683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:41.131021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:41.132723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f6dbf-79c3-4086-91b7-aafdbe0d8d1d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:41.146676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 15/29] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:01:41.148810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce89dc-c24e-405b-98ee-dd3b7e89dbd8 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.149101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce89dc-c24e-405b-98ee-dd3b7e89dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.150615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce89dc-c24e-405b-98ee-dd3b7e89dbd8 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.152615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:41.153654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce89dc-c24e-405b-98ee-dd3b7e89dbd8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:41.180976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555bc0b-ff0c-49db-8efe-09fdb2e02dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:41.181872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bc0b-ff0c-49db-8efe-09fdb2e02dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.182156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bc0b-ff0c-49db-8efe-09fdb2e02dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.182431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555bc0b-ff0c-49db-8efe-09fdb2e02dc9 None admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.187640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555bc0b-ff0c-49db-8efe-09fdb2e02dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:41.189184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555bc0b-ff0c-49db-8efe-09fdb2e02dc9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:41.190958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 15/31] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:40 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:01:41.192325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.192619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.192896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.227903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:41.229089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:41.269779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce89dc-c24e-405b-98ee-dd3b7e89dbd8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:41.321462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:41.322290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.322580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.323240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.324229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:41.325684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:41.333690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 16/32] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:41.334551 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:41.436466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b69b-00b6-4b77-8c57-1e0eb558688b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:41.470740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966825c-f519-48b2-aca9-e0461a51989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:41.471820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966825c-f519-48b2-aca9-e0461a51989c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.472238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966825c-f519-48b2-aca9-e0461a51989c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.472643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966825c-f519-48b2-aca9-e0461a51989c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.473970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966825c-f519-48b2-aca9-e0461a51989c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:41.475605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966825c-f519-48b2-aca9-e0461a51989c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:41.477722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 17/33] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:41.483499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38af5-cda6-4616-b4ae-4a1aa1fb8f39 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.483499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38af5-cda6-4616-b4ae-4a1aa1fb8f39 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.484228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38af5-cda6-4616-b4ae-4a1aa1fb8f39 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.486253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 18/34] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:41.489973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38af5-cda6-4616-b4ae-4a1aa1fb8f39 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:41.492940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 17/35] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:01:41 2022] POST /identity/v3/projects => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:41.494133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:41.603889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38af5-cda6-4616-b4ae-4a1aa1fb8f39 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:41.645546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce22187-9f03-4a63-b0cb-b2a6c733ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:41.646684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22187-9f03-4a63-b0cb-b2a6c733ffd2 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.647258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22187-9f03-4a63-b0cb-b2a6c733ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.647667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce22187-9f03-4a63-b0cb-b2a6c733ffd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.648558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce22187-9f03-4a63-b0cb-b2a6c733ffd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:41.650304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce22187-9f03-4a63-b0cb-b2a6c733ffd2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:41.749520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2e5e5-2678-4efb-b307-ab8a04046431 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:41.792988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:41.794233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.794715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.795249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] PATH_INFO: `/v3/domains/default/users/9f5e493603104e09ac10fad9a8d68de4/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.798122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9f5e493603104e09ac10fad9a8d68de4, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:41.798249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 19/36] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 4 08:01:41 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:41.799899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a31d1-8720-4458-b9a4-9cef7b804564 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:41.800419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a31d1-8720-4458-b9a4-9cef7b804564 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:41.800892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a31d1-8720-4458-b9a4-9cef7b804564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:41.808116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:41.828622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-943a31d1-8720-4458-b9a4-9cef7b804564 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:41.828967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 18/37] 10.222.0.59 () {58 vars in 1361 bytes} [Wed May 4 08:01:41 2022] PUT /identity/v3/domains/default/users/9f5e493603104e09ac10fad9a8d68de4/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:01:41.831915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-943a31d1-8720-4458-b9a4-9cef7b804564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:41.941882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 20/38] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:41.981394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:42.073747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498037-312b-4f00-a17e-c6a8fc6a6d90 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.074044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498037-312b-4f00-a17e-c6a8fc6a6d90 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.074226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498037-312b-4f00-a17e-c6a8fc6a6d90 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.078644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 21/39] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:01:42.081652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.081652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.081970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.112586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:42.113798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:42.134298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fbe38-562f-4fa4-a83a-8d12ab8e11a2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:42.183616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0af664-80af-4e77-b893-1ff55f01c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:42.184798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af664-80af-4e77-b893-1ff55f01c503 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.185766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af664-80af-4e77-b893-1ff55f01c503 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.186485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0af664-80af-4e77-b893-1ff55f01c503 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.189345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0af664-80af-4e77-b893-1ff55f01c503 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:42.191568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0af664-80af-4e77-b893-1ff55f01c503 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:42.194825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 22/40] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:42.212220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 19/41] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 4 08:01:41 2022] POST /identity/v3/roles => generated 225 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:42.220766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:42.262824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b08fb-6e81-47c3-ae99-04df608ae760 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.263527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b08fb-6e81-47c3-ae99-04df608ae760 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.264638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b08fb-6e81-47c3-ae99-04df608ae760 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.266708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 20/42] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:01:42.272504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.272784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.273060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.296951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:42.298993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:42.344500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab9d88-32f6-4daf-8663-308882f3802c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:42.384976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 21/43] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:01:42.390958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:42.390958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.390958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.390958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.391852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:42.393527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:42.395484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 23/44] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:42.401365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:42.410784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:42.532980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb3f26-d4e3-4e8f-b893-bd9d0ad1429d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:42.538707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33244-62a2-4f55-bf05-239769b76c6b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:42.565978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0077-4e00-4cb9-a136-102cba135e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:42.566643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0077-4e00-4cb9-a136-102cba135e8d None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.566985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0077-4e00-4cb9-a136-102cba135e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.567226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0077-4e00-4cb9-a136-102cba135e8d None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.567929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0077-4e00-4cb9-a136-102cba135e8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:42.569705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0077-4e00-4cb9-a136-102cba135e8d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:42.571305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb46b-5f54-49a3-aa74-3721a00ffe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:42.571970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb46b-5f54-49a3-aa74-3721a00ffe23 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:42.572253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb46b-5f54-49a3-aa74-3721a00ffe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:42.572522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb46b-5f54-49a3-aa74-3721a00ffe23 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:42.573262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb46b-5f54-49a3-aa74-3721a00ffe23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:42.574637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb46b-5f54-49a3-aa74-3721a00ffe23 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:42.588919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 24/45] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 4 08:01:42 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:01:42.595845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 22/46] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:01:42 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:44.225493 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a622f10-e92f-4940-a78d-b7115c9a26c5 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.226011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a622f10-e92f-4940-a78d-b7115c9a26c5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.226124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a622f10-e92f-4940-a78d-b7115c9a26c5 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.227614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 25/47] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:44.233251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.233627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.233814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.252162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:44.253351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:44.321749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 23/48] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:44.345727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a622f10-e92f-4940-a78d-b7115c9a26c5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:44.452005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a622f10-e92f-4940-a78d-b7115c9a26c5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:44.486084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:44.486845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.487176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.487473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.498293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:44.505899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:44.506909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:01:44.507942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 26/49] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:44.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:44.611330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451f1df-5251-4e5d-9202-61c76b038af8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:44.644481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:44.645138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.645413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.645679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.646423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:44.646723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:44.648129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:44.660982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 24/50] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:44.666790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:44.777125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d929190-0439-4903-a790-302f98b5a667 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:44.815502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5dcbd-89fd-4abb-9d12-c18771d17edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:44.816374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5dcbd-89fd-4abb-9d12-c18771d17edb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.816658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5dcbd-89fd-4abb-9d12-c18771d17edb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.816934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5dcbd-89fd-4abb-9d12-c18771d17edb None admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.818179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5dcbd-89fd-4abb-9d12-c18771d17edb None admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:44.819993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5dcbd-89fd-4abb-9d12-c18771d17edb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:44.821615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 27/51] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:44 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:44.827277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:44.856184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877943-8e7b-4977-a4d1-f8d649fca3e9 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.856469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877943-8e7b-4977-a4d1-f8d649fca3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.856740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87877943-8e7b-4977-a4d1-f8d649fca3e9 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.858108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 28/52] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:44.863047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61430-876d-411e-996f-14792373ee8f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.863337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61430-876d-411e-996f-14792373ee8f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.863615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61430-876d-411e-996f-14792373ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.880851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-53a61430-876d-411e-996f-14792373ee8f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:44.882045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-53a61430-876d-411e-996f-14792373ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:44.930725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79d2e-b302-4010-b652-a628def710c6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:44.948369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 29/53] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:44.963546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:44.964335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:44.964615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:44.964889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:44.966095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:44.967573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:44.969174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 25/54] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:44.971350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61430-876d-411e-996f-14792373ee8f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:44.975105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:45.068861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db785bb6-0f38-4b1b-9e64-aec8bdfe599c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:45.070175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61430-876d-411e-996f-14792373ee8f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:45.101932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:45.102573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:45.102861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:45.103160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:45.103942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:45.104077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.domain.id=default, user.id=9f5e493603104e09ac10fad9a8d68de4) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:45.104255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:45.104734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:45.105015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:45.105283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:45.105749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101eeb1-5e38-4da5-a83e-0cd8b7e9b523 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:45.106472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:45.107938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:45.109522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 30/55] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:45.113945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 26/56] 10.222.0.59 () {56 vars in 1322 bytes} [Wed May 4 08:01:44 2022] GET /identity/v3/role_assignments?user.id=9f5e493603104e09ac10fad9a8d68de4&scope.domain.id=default&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:45.115193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:45.220316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6286e-a45d-40ec-86f0-f8a51fc39697 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:45.266693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979720cd-6a46-4491-8229-9f8ce6615604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:45.267524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979720cd-6a46-4491-8229-9f8ce6615604 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:45.267798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979720cd-6a46-4491-8229-9f8ce6615604 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:45.268079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979720cd-6a46-4491-8229-9f8ce6615604 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:45.268800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979720cd-6a46-4491-8229-9f8ce6615604 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:45.270281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979720cd-6a46-4491-8229-9f8ce6615604 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:45.303334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 31/57] 10.222.0.59 () {60 vars in 1140 bytes} [Wed May 4 08:01:45 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:47.554516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731b32-184d-4d3c-ae3b-87a0a897e409 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:47.555403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731b32-184d-4d3c-ae3b-87a0a897e409 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:47.555523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731b32-184d-4d3c-ae3b-87a0a897e409 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:47.557709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 27/58] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:47.563975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:47.564422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:47.564505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:47.581765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:47.582914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:47.656838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 32/59] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:47.686006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731b32-184d-4d3c-ae3b-87a0a897e409 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:47.815493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731b32-184d-4d3c-ae3b-87a0a897e409 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:47.849203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70eb8a-5b2d-4538-8b4e-3e4887451cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:47.849969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70eb8a-5b2d-4538-8b4e-3e4887451cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:47.850256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70eb8a-5b2d-4538-8b4e-3e4887451cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:47.850524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70eb8a-5b2d-4538-8b4e-3e4887451cf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:47.851834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70eb8a-5b2d-4538-8b4e-3e4887451cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:47.853302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70eb8a-5b2d-4538-8b4e-3e4887451cf2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:47.854918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 28/60] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:47.860822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:47.959525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdae721-fcc5-49ec-9b55-b8643de9420b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:47.992889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f95db3-4d1c-4111-8b07-bdeaa9fbc9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:47.993539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f95db3-4d1c-4111-8b07-bdeaa9fbc9a9 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:47.993817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f95db3-4d1c-4111-8b07-bdeaa9fbc9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:47.994093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f95db3-4d1c-4111-8b07-bdeaa9fbc9a9 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:47.994792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f95db3-4d1c-4111-8b07-bdeaa9fbc9a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:47.996279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f95db3-4d1c-4111-8b07-bdeaa9fbc9a9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:48.025838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 33/61] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:01:47 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:51.412421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b813fb-a5f3-489b-be93-c1ca55d8eff1 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.413290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b813fb-a5f3-489b-be93-c1ca55d8eff1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.413787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b813fb-a5f3-489b-be93-c1ca55d8eff1 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.415409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 29/62] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:51.420960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fc1c-44d1-4ba3-8fa0-ca3c1c184ed8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.421382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fc1c-44d1-4ba3-8fa0-ca3c1c184ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.421505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fc1c-44d1-4ba3-8fa0-ca3c1c184ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.444276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d986fc1c-44d1-4ba3-8fa0-ca3c1c184ed8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:51.445777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d986fc1c-44d1-4ba3-8fa0-ca3c1c184ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:51.531126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 34/63] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:51.567121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b813fb-a5f3-489b-be93-c1ca55d8eff1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:51.582259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2db8f3-65c1-4e67-8e3c-626b50caee14 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.582846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2db8f3-65c1-4e67-8e3c-626b50caee14 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.583324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2db8f3-65c1-4e67-8e3c-626b50caee14 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.584853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 35/64] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:51.589931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069efaf-6efd-4e58-a94b-6f1dd2591b02 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.590410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069efaf-6efd-4e58-a94b-6f1dd2591b02 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.590850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069efaf-6efd-4e58-a94b-6f1dd2591b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.622556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8069efaf-6efd-4e58-a94b-6f1dd2591b02 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:51.624743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8069efaf-6efd-4e58-a94b-6f1dd2591b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:51.705432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b813fb-a5f3-489b-be93-c1ca55d8eff1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:51.721107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 36/65] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:51.722806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1bdf0-7591-41f4-9da0-1e0482b03c3e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.723179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1bdf0-7591-41f4-9da0-1e0482b03c3e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.723504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1bdf0-7591-41f4-9da0-1e0482b03c3e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.726233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 37/66] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:51.732162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.732523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.732903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.745099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:51.746105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.746524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.746950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.752400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:51.753854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:51.762845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:51.772254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:51.773213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:51.774208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:51.777329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 30/67] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:51.778373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:51.832395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 38/68] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:51.839165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:51.903113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ea680-d592-4a59-944f-0aa81aadab17 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:51.935392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:51.936199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.936472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.936898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.947293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:51.949194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37a847-898b-46ae-83eb-e21883f9a811 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:51.954920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:51.955828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:51.956624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 31/69] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:51.957794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:51.988677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:51.989346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:51.989623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:51.989889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:51.990631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:51.990961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:51.992361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10c3e-83da-42c5-8a08-084d07e1140f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.000438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 39/70] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:01:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.001874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00ec8-c00f-498b-b6ae-3825176eb18e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.002295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00ec8-c00f-498b-b6ae-3825176eb18e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.002700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc00ec8-c00f-498b-b6ae-3825176eb18e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.004064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 40/71] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:52.007965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00ec8-c00f-498b-b6ae-3825176eb18e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.065561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b18a-004e-4c20-88ec-f13541fefcdf None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.103281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.104121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.104424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.104718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.112619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc00ec8-c00f-498b-b6ae-3825176eb18e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.115139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:52.123318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:52.124215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:52.125005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 32/72] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:01:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:52.125651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.149822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.150497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.150780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.151094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.151840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:52.152225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.153712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d3e7e-a21d-47b0-bc60-2e3477865510 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.162351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 41/73] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.163602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713523a8-49dd-4486-9450-67d51482102c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.163886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713523a8-49dd-4486-9450-67d51482102c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.164181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713523a8-49dd-4486-9450-67d51482102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.180182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-713523a8-49dd-4486-9450-67d51482102c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:52.181383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-713523a8-49dd-4486-9450-67d51482102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:52.226185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595181bc-32fd-411f-95f3-28d9e7a66ee5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.246521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 42/74] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:52.248087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eedba-f159-4b81-ae14-7dae6bcc98c2 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.248087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eedba-f159-4b81-ae14-7dae6bcc98c2 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.248294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eedba-f159-4b81-ae14-7dae6bcc98c2 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.249625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 43/75] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:52.250090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eedba-f159-4b81-ae14-7dae6bcc98c2 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.263882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.264758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.265066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.265356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.280318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.281781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.283548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 33/76] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.285427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.352378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eedba-f159-4b81-ae14-7dae6bcc98c2 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.385852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced35cf-2925-4e06-8098-dc175ae9c5d1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.389496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.390168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.390450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.390726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.391539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:52.391842 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.393249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff63846-e6b2-4f2c-b82e-4c792f80d77d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.403413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 44/77] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.403549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.403759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.404032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.420523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:52.421725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:52.431447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.432349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.432630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.432900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.434266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.436027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.438178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 34/78] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.438178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.488732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 45/79] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:52.490637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.535556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9400ce-ff22-4fb7-8237-4888789b62d8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.567180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.567972 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.568250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.568835 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.578561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:52.583268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66ccb-33b4-4683-8e14-506bf5d3030e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:52.586152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:52.587091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:52.587971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 35/80] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:52.588690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.616552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.617226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.617504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.617771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.679660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.681142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.685084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87397d6-8880-4784-8c16-f3a4d2a031f8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.717076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.717935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.718215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.718487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.719754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.721241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.722863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 36/81] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.724797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.779944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 46/82] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:01:52.781057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.819975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77adb0-7c6a-4ea8-b3ee-bdd309dc9513 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.850506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.851178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.851466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.851740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.874593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eff755-2c21-4c21-ad5d-20b741724156 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:52.906504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:52.907375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:52.907655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:52.907905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:52.909129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.910602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:52.912256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 47/83] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:52.913005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:52.916215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:52.917789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.011136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 37/84] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:01:53.011374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec52b-7e35-4c82-bcb7-e4a2b87b2872 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.011956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.044653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.045244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.045524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.045797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.046540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:53.046842 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.048277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.056013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 48/85] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.056783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.107131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a35c7-5f9f-4f90-ab22-7e54c2d124c2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.139725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.140366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.140639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.140909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.147573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dc1af-4464-449a-aa94-0a6a7fc49241 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.179778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.180624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.180902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.181168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.182368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.183822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.190513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 49/86] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.190513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.206598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.208107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.284183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9aaa90-2d4d-4032-a09d-9bf68b2b7a88 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.305984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 38/87] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:01:53.307037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.315821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.316488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.316763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.317044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.317705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.319484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.338441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 50/88] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:01:53 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:53.339259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.417447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c9cec-f80b-46f7-83b1-31c1baad3a94 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.442280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203346c-861f-4c00-9111-ee1c48bddaf1 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.453320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.454272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.454549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.454805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.456100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.457586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.459381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 39/89] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.460295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.481595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.482860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.483222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.483500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.484860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.486572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.493404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 51/90] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.493404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.561462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf92e6-3022-4fed-bd93-fd1f68359761 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.593485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9db13-20f4-4254-8f45-58a196d5aadf None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.598744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.599505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.599784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.600055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.600884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=86e9df2ea0c64543b814c1aa6b7b6b95) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:53.602957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.602957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.608857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 40/91] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/role_assignments?user.id=86e9df2ea0c64543b814c1aa6b7b6b95&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.609934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.636116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.636897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.637176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.637447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.638874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.640526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.642513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 52/92] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.647022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.735201 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96326e9-32fd-491d-8936-f442a6dc3623 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.778846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abc753-28bc-46f0-af2b-fe5dc9612f2d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.781200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.785428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.786419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.787285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.788476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=9f5e493603104e09ac10fad9a8d68de4) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:53.789066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.792086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.798937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 41/93] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/role_assignments?user.id=9f5e493603104e09ac10fad9a8d68de4&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:53.800150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:53.831787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.832400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.832716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.833022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.945642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d154-00b9-48c9-8091-a8912e874416 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:53.980885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:53.981927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:53.982412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:53.982900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:53.983938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] RBAC: Adding query filter params (role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=86e9df2ea0c64543b814c1aa6b7b6b95) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:53.984112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.984618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:53.985677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.986614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:53.993161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 42/94] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/role_assignments?user.id=86e9df2ea0c64543b814c1aa6b7b6b95&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=85adb51ebde647209c75f54b8c949bdc => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:54.146524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 53/95] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:01:54.152434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:54.304154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e7b55-b2c0-4f34-b73a-a02a352e1ccd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:54.353466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf9a3-9bdc-410d-8e8a-dc6cab0c7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:54.354351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf9a3-9bdc-410d-8e8a-dc6cab0c7d03 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:54.354638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf9a3-9bdc-410d-8e8a-dc6cab0c7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:54.354942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf9a3-9bdc-410d-8e8a-dc6cab0c7d03 None admin] PATH_INFO: `/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:54.356157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cf9a3-9bdc-410d-8e8a-dc6cab0c7d03 None admin] RBAC: Authorizing `identity:get_project(project_id=ce5d3dad7bfe40bfbc1fcfee12e07f67)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:54.357607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cf9a3-9bdc-410d-8e8a-dc6cab0c7d03 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:54.359358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 43/96] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:54 2022] GET /identity/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:54.365420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:54.522573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf049ee-fb61-4b17-9c4d-db81780c3ba0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:54.565567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:54.566241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:54.566517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:54.566787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:54.567651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=ce5d3dad7bfe40bfbc1fcfee12e07f67, user.id=86e9df2ea0c64543b814c1aa6b7b6b95) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:54.567954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:54.570185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac069e-5368-406a-9769-62fe411be931 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:54.580234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 54/97] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:01:54 2022] GET /identity/v3/role_assignments?user.id=86e9df2ea0c64543b814c1aa6b7b6b95&scope.project.id=ce5d3dad7bfe40bfbc1fcfee12e07f67&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:56.497001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d6a5c-ecbb-4258-90c5-a3cd82c08952 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:56.497974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d6a5c-ecbb-4258-90c5-a3cd82c08952 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:56.498452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d6a5c-ecbb-4258-90c5-a3cd82c08952 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:56.500162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 44/98] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:56.506579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:56.507104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:56.507177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:56.524966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:56.526177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:56.606700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 55/99] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:56.629404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d6a5c-ecbb-4258-90c5-a3cd82c08952 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:56.730285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d6a5c-ecbb-4258-90c5-a3cd82c08952 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:56.764984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a7cdd-b108-432a-a688-827efd1ba8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:56.765789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7cdd-b108-432a-a688-827efd1ba8ec None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:56.766065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7cdd-b108-432a-a688-827efd1ba8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:56.766384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7cdd-b108-432a-a688-827efd1ba8ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:56.767574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a7cdd-b108-432a-a688-827efd1ba8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:56.769017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a7cdd-b108-432a-a688-827efd1ba8ec None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:56.770632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 45/100] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:56.776432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:56.891777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af199-97a7-4fe7-ac5d-f863fb38ed77 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:56.934429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217826-3318-4e2d-ae75-b87bf3082b61 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:56.934758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217826-3318-4e2d-ae75-b87bf3082b61 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:56.934994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217826-3318-4e2d-ae75-b87bf3082b61 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:56.936348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 46/101] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:56.936624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b6c7-aa86-4659-b384-ecf42d7ce550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:56.937283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b6c7-aa86-4659-b384-ecf42d7ce550 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:56.937615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b6c7-aa86-4659-b384-ecf42d7ce550 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:56.937884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b6c7-aa86-4659-b384-ecf42d7ce550 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:56.938615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7b6c7-aa86-4659-b384-ecf42d7ce550 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:56.940158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7b6c7-aa86-4659-b384-ecf42d7ce550 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:56.941339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:56.941612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:56.941878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:56.963890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:56.965413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:56.986210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 56/102] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:01:56 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:01:57.011423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2f53-366e-4081-8608-8c4ea89c9d29 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.011764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2f53-366e-4081-8608-8c4ea89c9d29 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.011975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2f53-366e-4081-8608-8c4ea89c9d29 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.013391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 57/103] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:01:57.019419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.019709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.019970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.045884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:57.047215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:57.048820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 47/104] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:01:57.084490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.117955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 58/105] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:01:57.153339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.201387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716a38-5dc6-45f0-856c-36024b1c0c23 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.263946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.265089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.265615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.266167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.290408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:57.298410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:57.299443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:57.300235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 48/106] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:01:57.305817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.374491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41806412-b8b0-451b-888b-f3363baaaeb6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.405923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a287e5b-6922-4a00-a287-ad145750c660 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.439280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.440202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.440616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.441026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.441915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:57.442489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:57.444443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:57.448179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6f24-8789-48fb-b4f4-9786c46c9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.449145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6f24-8789-48fb-b4f4-9786c46c9fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.449533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6f24-8789-48fb-b4f4-9786c46c9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.449903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6f24-8789-48fb-b4f4-9786c46c9fb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.454734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 49/107] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:57.460414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.466650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6f24-8789-48fb-b4f4-9786c46c9fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-46df6f24-8789-48fb-b4f4-9786c46c9fb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:57.476446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:57.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:01:57.478249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:01:57.480709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 59/108] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:57.482127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce5637-a6e0-4f0e-9c58-cd3cd75fe401 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.482580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce5637-a6e0-4f0e-9c58-cd3cd75fe401 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.487177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce5637-a6e0-4f0e-9c58-cd3cd75fe401 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.487177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 60/109] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:57.487177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87b836-133a-48d9-80a1-835c2674dffc None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.487177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87b836-133a-48d9-80a1-835c2674dffc None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.487487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87b836-133a-48d9-80a1-835c2674dffc None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.488982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 61/110] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:57.493870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87b836-133a-48d9-80a1-835c2674dffc None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.563681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6282e-fc97-47e6-bda7-7e65a4b750ea None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.596076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87b836-133a-48d9-80a1-835c2674dffc None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.597081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d589ecd-5f9d-4941-9123-bf75f45641d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.598134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d589ecd-5f9d-4941-9123-bf75f45641d5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.598649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d589ecd-5f9d-4941-9123-bf75f45641d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.599089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d589ecd-5f9d-4941-9123-bf75f45641d5 None admin] PATH_INFO: `/v3/users/bc4705733f6d45da80bf74aee6c2353c` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.612938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d589ecd-5f9d-4941-9123-bf75f45641d5 None admin] RBAC: Authorizing `identity:get_user(user_id=bc4705733f6d45da80bf74aee6c2353c)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:57.614398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d589ecd-5f9d-4941-9123-bf75f45641d5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:57.616141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 50/111] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/users/bc4705733f6d45da80bf74aee6c2353c => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:01:57.621746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.622260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.622687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.634364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.635072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.635360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.635633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.636580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:57.637060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:57.638769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04830d-ad4f-4341-add1-8180f6756696 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:57.639688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:57.640846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:57.647845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 62/112] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:57.649335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.649801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.650275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.666802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:57.668252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:57.706668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 51/113] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:57.707559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.736523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 63/114] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:57.742912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:57.805486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c257d8d-2200-483b-8852-ddb5e56094f0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.843303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.843921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.844437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.844841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.881417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e07e-a9f2-46ed-b4cb-adeefac8870f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:57.910480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:57.912275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:57.925156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:57.926293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:57.926649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:57.927364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:57.928942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:57.931225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:57.932943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 64/115] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:57.934263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.029584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 52/116] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:01:58.035664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.042838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4557-cd30-479a-bbac-d6aeafe49d5e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.087799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.088988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.089346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.089695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.102982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:58.112721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:58.113593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:01:58.114362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 65/117] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:58.115575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.141161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6452e65-8532-4eb9-8592-0ab6c999c214 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.178845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.179684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.179961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.180276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.191598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:58.199749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:58.200636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:01:58.201427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 53/118] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:58.202064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.233486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdb2a8-9ce1-4520-92b4-c521f066f888 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.265921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.266822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.267131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.267408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.268598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.270062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.271801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 66/119] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.272632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.302200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e411b1-859c-4710-930a-edb9d16dd280 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.333610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.334471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.334741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.335048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.336223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.337666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.344185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 54/120] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.344185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.373833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdcab9-2129-46a5-8758-0ea1c7c57893 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.412593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.413208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.413486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.413757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.414510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:58.414801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.416219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8ff9-d239-4187-9343-8558b7c3e619 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.424597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 67/121] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.425662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dde7-d658-4389-af43-600144cdf735 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.425947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dde7-d658-4389-af43-600144cdf735 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.426217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dde7-d658-4389-af43-600144cdf735 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.431118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 68/122] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:01:58.431118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0dde7-d658-4389-af43-600144cdf735 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.453020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff5c75-c4f2-4e4c-bb01-33d7fec0b324 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.485969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.486649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.486961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.487263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.487996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:58.488306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.489703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.498527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 55/123] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.504016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.532448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0dde7-d658-4389-af43-600144cdf735 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.566594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.567524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.567948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.568124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/86e9df2ea0c64543b814c1aa6b7b6b95/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.570662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] RBAC: Authorizing `identity:create_grant(project_id=6a34e27a9e9c4905968993041711ccdb, user_id=86e9df2ea0c64543b814c1aa6b7b6b95, role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.572184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.589706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 69/124] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:01:58 2022] PUT /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/86e9df2ea0c64543b814c1aa6b7b6b95/roles/85adb51ebde647209c75f54b8c949bdc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:01:58.590533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.622493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0706157-dd7c-478f-acc0-b596fd98aaf4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.658463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.659087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.659369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.659639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.660474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] RBAC: Adding query filter params (role.id=5ababcfa963a4528801ab31a5847a2f2, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=bc4705733f6d45da80bf74aee6c2353c) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:58.660824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.662305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4848d2-5387-4dc2-b7d9-f4c328f6fe56 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.668364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 56/125] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/role_assignments?user.id=bc4705733f6d45da80bf74aee6c2353c&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=5ababcfa963a4528801ab31a5847a2f2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.676568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.676888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.677117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.712405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:58.713303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:58.715954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bad422-d6a9-4761-a111-8f8a22233e5b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.753870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.755203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.756418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.756903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.760587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.764452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.772734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 70/126] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.774062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.855035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 57/127] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:01:58.855735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.921028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2518038-7234-4430-8e05-d393dad18aa0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:58.964720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:58.965607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:58.966321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:58.966659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:58.969498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:58.972411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:58.974638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 71/128] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:58.976223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:58.983263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1dfa6-7f46-4fec-991a-5b7f55d3d5e9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.049350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.050224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.050503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.050772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.053244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:59.056500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:59.059457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 58/129] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:59.060228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:59.178471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25f5be-fa14-4ec4-8dad-f53a574c37ef None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.226553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53ae28-9566-43f3-9fb6-2f92aef0974e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.244280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.245082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.245359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.247419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.274112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:01:59.293917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.294785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.295083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.295424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:01:59.296348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:01:59.298440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 72/130] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:01:59.300400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:59.305359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:59.311180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:59.312949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 59/131] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:59 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:59.313714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:59.452840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35c68-7542-447d-91a2-1fc721230ef7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.459093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e42423-a84f-4365-af3d-5ef67c02cd99 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.492927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.493870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.494149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.494417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/9f5e493603104e09ac10fad9a8d68de4/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.496458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a34e27a9e9c4905968993041711ccdb, user_id=9f5e493603104e09ac10fad9a8d68de4, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:59.497923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:59.508235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.508923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.509284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.509559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.510334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:01:59.510634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:59.514842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:59.519071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 73/132] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:01:59 2022] PUT /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/9f5e493603104e09ac10fad9a8d68de4/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:01:59.519993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:59.535180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 60/133] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:59.544331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:59.640309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57b8f1-6091-43d4-bd94-9d090c7e4b78 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.679459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0fd60-99c9-4626-b3d8-14104dd962e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.680363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fd60-99c9-4626-b3d8-14104dd962e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.680642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fd60-99c9-4626-b3d8-14104dd962e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.680910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0fd60-99c9-4626-b3d8-14104dd962e1 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/86e9df2ea0c64543b814c1aa6b7b6b95/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.683115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0fd60-99c9-4626-b3d8-14104dd962e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a34e27a9e9c4905968993041711ccdb, user_id=86e9df2ea0c64543b814c1aa6b7b6b95, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:59.685585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0fd60-99c9-4626-b3d8-14104dd962e1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:59.711158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 74/134] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:01:59 2022] PUT /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/86e9df2ea0c64543b814c1aa6b7b6b95/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:01:59.724152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41aad5-5692-4c02-a586-106bed31349f None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.724787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41aad5-5692-4c02-a586-106bed31349f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.724787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41aad5-5692-4c02-a586-106bed31349f None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.726083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 75/135] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:01:59.731823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.732124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.732379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.735856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6979226-4a1b-42b8-a0aa-093d1c269302 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:01:59.751928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:01:59.753185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:01:59.868054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:01:59.869584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:01:59.870076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:01:59.870565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:01:59.872347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 76/136] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:01:59.873498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:01:59.876206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:01:59.879186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 61/137] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:01:59 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:01:59.884957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:01:59.941624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:00.051665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8cbf2-0a84-4942-a7f1-4e6747aadee6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:00.101432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:00.102661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:00.103038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:00.103503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] PATH_INFO: `/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:00.105346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] RBAC: Authorizing `identity:get_project(project_id=ce5d3dad7bfe40bfbc1fcfee12e07f67)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:00.107332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:00.109558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 77/138] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:01:59 2022] GET /identity/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:00.110745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd22e6-2d3b-4024-ae0e-d4bee0379b34 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:00.116233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:00.146394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:00.147372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:00.147742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:00.148085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:00.150905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:00.152574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:00.154646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 62/139] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:01:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:00.160673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:00.276158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c454d70-d787-4d84-b1cf-f96c9fe2116b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:00.349655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cba86-cc35-4cf5-9321-a0d67e31effb None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:00.351631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80677d-63ba-4b21-a851-a73e3883745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:00.352548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80677d-63ba-4b21-a851-a73e3883745d None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:00.352830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80677d-63ba-4b21-a851-a73e3883745d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:00.353105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80677d-63ba-4b21-a851-a73e3883745d None admin] PATH_INFO: `/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67/users/86e9df2ea0c64543b814c1aa6b7b6b95/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:00.355145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80677d-63ba-4b21-a851-a73e3883745d None admin] RBAC: Authorizing `identity:create_grant(project_id=ce5d3dad7bfe40bfbc1fcfee12e07f67, user_id=86e9df2ea0c64543b814c1aa6b7b6b95, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:00.356606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80677d-63ba-4b21-a851-a73e3883745d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:00.376210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 78/140] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:00 2022] PUT /identity/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67/users/86e9df2ea0c64543b814c1aa6b7b6b95/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:02:00.413108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc6f1-9a07-4585-924a-990992064deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:00.413802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc6f1-9a07-4585-924a-990992064deb None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:00.414085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc6f1-9a07-4585-924a-990992064deb None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:00.414360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc6f1-9a07-4585-924a-990992064deb None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:00.415120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddc6f1-9a07-4585-924a-990992064deb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:00.416777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddc6f1-9a07-4585-924a-990992064deb None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:00.459009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 63/141] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:00 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:01.697342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582626d-c07d-4af8-bc68-e073c45812d1 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:01.697841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582626d-c07d-4af8-bc68-e073c45812d1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:01.697841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582626d-c07d-4af8-bc68-e073c45812d1 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:01.699363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 79/142] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:01.704659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4c5e-6998-439d-9c0d-3bc80b66ebdd None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:01.705066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4c5e-6998-439d-9c0d-3bc80b66ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:01.705248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4c5e-6998-439d-9c0d-3bc80b66ebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:01.724732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-601c4c5e-6998-439d-9c0d-3bc80b66ebdd None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:01.726390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-601c4c5e-6998-439d-9c0d-3bc80b66ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:01.808539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 64/143] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:01.843919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582626d-c07d-4af8-bc68-e073c45812d1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:01.940113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777cd8f-5d28-4340-9c7a-572e485f0fd0 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:01.940430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777cd8f-5d28-4340-9c7a-572e485f0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:01.940658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777cd8f-5d28-4340-9c7a-572e485f0fd0 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:01.942351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 65/144] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:01.948500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:01.948500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:01.948500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:01.977104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:01.978299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:01.979153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582626d-c07d-4af8-bc68-e073c45812d1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.061702 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.063079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.063560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.064027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.066412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 66/145] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:02.091854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:02.100339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:02.101304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:02.102145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:02.104715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 80/146] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:02.111456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.114312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.275842 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76402c2e-12ad-48af-89f3-23fd5fff0a2e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.294707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e51ce0-f631-49ca-986c-2909a7a16a84 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.334681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.335525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.335798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.336065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.347801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.348489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.348765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.349036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.349799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:02.350105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:02.351529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:02.358971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:02.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:02.367950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:02.368739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:02.371703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 81/147] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:02.375438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 67/148] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:02.376357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.382569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.529176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d75826-636c-46e9-ae97-053c784fe7dd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.571812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.572712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.572993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.573264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] PATH_INFO: `/v3/users/bc4705733f6d45da80bf74aee6c2353c` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.579649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] RBAC: Authorizing `identity:get_user(user_id=bc4705733f6d45da80bf74aee6c2353c)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:02.581208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:02.583264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 68/149] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/users/bc4705733f6d45da80bf74aee6c2353c => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:02.595809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.629055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e76d8-f1d4-4a69-a954-34b9d284540c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.708963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.709739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.709906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.710175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.710970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:02.711276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:02.712663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:02.713599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870802f9-794a-41dc-83fe-4df12dd5d9b2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.726439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 82/150] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:02.732109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.754461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.755280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.755773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.756270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.763786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:02.765320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:02.767122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 69/151] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:02.796140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.856035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70f140-95e0-4a08-b71a-a73a4f4a071e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.894399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.895343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.895625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.895914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.899586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:02.901071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:02.903196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 83/152] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:02.908223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:02.918850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beffcae-c21c-4f1c-9235-0fb0f01ba00d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:02.963625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:02.964546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:02.964828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:02.965101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/bc4705733f6d45da80bf74aee6c2353c/roles/5ababcfa963a4528801ab31a5847a2f2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:02.967173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a34e27a9e9c4905968993041711ccdb, user_id=bc4705733f6d45da80bf74aee6c2353c, role_id=5ababcfa963a4528801ab31a5847a2f2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:02.968625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:02.988814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 70/153] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:02 2022] PUT /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb/users/bc4705733f6d45da80bf74aee6c2353c/roles/5ababcfa963a4528801ab31a5847a2f2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:02:03.028147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479361e-5dca-465b-8c71-859b04a38878 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:03.070959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:03.071552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.071865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.072100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.146474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:03.147979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:03.255330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 84/154] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:02:03.261276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:03.421771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20f72f-2a0a-4f3c-8278-ecab7ac7e3e1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:03.473506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a9a24-387b-4291-8cfc-db1717941f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:03.474407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9a24-387b-4291-8cfc-db1717941f42 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.474687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9a24-387b-4291-8cfc-db1717941f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.474989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9a24-387b-4291-8cfc-db1717941f42 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.479670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a9a24-387b-4291-8cfc-db1717941f42 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:03.481127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a9a24-387b-4291-8cfc-db1717941f42 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:03.482874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 71/155] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:03 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:03.489045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:03.527009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019148a-38ca-4f05-907a-521b76b9faaa None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.527341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019148a-38ca-4f05-907a-521b76b9faaa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.527751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019148a-38ca-4f05-907a-521b76b9faaa None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.529127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 72/156] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:03.539621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.539948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.540177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.581380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:03.582580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:03.685829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705a5c9-f152-4625-93ea-b9214fe0c3fa None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:03.693554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 73/157] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:03.742275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:03.742998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.743246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.743513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.744351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] RBAC: Adding query filter params (role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=86e9df2ea0c64543b814c1aa6b7b6b95) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:03.744649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:03.746095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caa4d8-8b8a-476d-9dae-055efa9db59f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:03.752476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 85/158] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:03 2022] GET /identity/v3/role_assignments?user.id=86e9df2ea0c64543b814c1aa6b7b6b95&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=85adb51ebde647209c75f54b8c949bdc => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:03.756985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:03.826911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304267-f726-4a6c-b50d-8d593f56b400 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.826911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304267-f726-4a6c-b50d-8d593f56b400 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.826911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304267-f726-4a6c-b50d-8d593f56b400 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.826911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 86/159] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:03.844469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.844820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.845033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.878923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:03.878923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:03.896913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80319b64-387c-43be-b4e9-a363973b0b7f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:03.955081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:03.956251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:03.956738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:03.957238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:03.975809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:03.981252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 87/160] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:03.987336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:03.988247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:03.989018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:03.995536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 74/161] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:04.001542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.039936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.120344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94135862-07c2-47b6-904f-5eb1af62261e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.160924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:04.161607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.161877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.162142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.162921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:04.163217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:04.164603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:04.182833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 88/162] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:04.190451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.210342 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80e5f-4917-4efc-ad85-b998fbbf7508 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.266801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:04.268376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.268376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.268376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.284541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:04.300732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:04.301800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:04.302597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 75/163] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:04.309074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.393052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49615f4-50bb-472a-b512-01765eb5255d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.448856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187f1c-3ff4-4872-91b7-40fa2171ff94 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.491899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:04.492722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.493011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.493268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.494573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:04.496044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:04.498022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 89/164] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:04.505472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:04.505939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.506181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.506470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.506752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.507560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:04.507868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:04.509250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:04.518427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 76/165] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:04.529993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.643953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028e2c6-a949-4059-9169-34dc22fede02 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.686261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:04.687173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.687720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] PATH_INFO: `/v3/users/9f5e493603104e09ac10fad9a8d68de4` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.695918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] RBAC: Authorizing `identity:get_user(user_id=9f5e493603104e09ac10fad9a8d68de4)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:04.697404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:04.703191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 77/166] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/users/9f5e493603104e09ac10fad9a8d68de4 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:04.710864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:04.716441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c550984-3592-4e13-9aab-a183c6b3a27e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.767771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c6dc5-4a63-4d44-861a-824c0cf658eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:04.768399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6dc5-4a63-4d44-861a-824c0cf658eb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.768651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6dc5-4a63-4d44-861a-824c0cf658eb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.768991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c6dc5-4a63-4d44-861a-824c0cf658eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.859969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c6dc5-4a63-4d44-861a-824c0cf658eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:04.861438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c6dc5-4a63-4d44-861a-824c0cf658eb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:04.938658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ab5f-0a1d-4691-bfe0-4e0d0f10fd85 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:04.957711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 90/167] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:04.959072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8995764-d679-45ae-972a-dabbd530bbd0 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:04.959352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8995764-d679-45ae-972a-dabbd530bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:04.959622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8995764-d679-45ae-972a-dabbd530bbd0 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:04.961125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 91/168] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:04.963215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8995764-d679-45ae-972a-dabbd530bbd0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:05.012209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48ef36-3f52-4c78-8f45-1c91929dc256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:05.012868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48ef36-3f52-4c78-8f45-1c91929dc256 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.013142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48ef36-3f52-4c78-8f45-1c91929dc256 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.013408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48ef36-3f52-4c78-8f45-1c91929dc256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.090700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48ef36-3f52-4c78-8f45-1c91929dc256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:05.092549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48ef36-3f52-4c78-8f45-1c91929dc256 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:05.180531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8995764-d679-45ae-972a-dabbd530bbd0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:05.198750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 78/169] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:02:05.208908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.209199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.209458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.240288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:05.241489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:05.299904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:05.300794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.301074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.301341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.302589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:05.304075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:05.306091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 92/170] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:04 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:05.306860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:05.341847 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 79/171] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:05.342761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:05.446798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa685375-b9ba-4402-8de0-d91c1d8c8b65 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:05.516062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bdfb1-7197-4cf1-85ed-3403450aaba6 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:05.524954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:05.525893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.526371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.526865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.527939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=86e9df2ea0c64543b814c1aa6b7b6b95) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:05.528445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:05.530086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:05.545443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 80/172] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:05 2022] GET /identity/v3/role_assignments?user.id=86e9df2ea0c64543b814c1aa6b7b6b95&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:05.546676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:05.569122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:05.570355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.570829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.571342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.574345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:05.576197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:05.579674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 93/173] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:05 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:05.585695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:05.774361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe745-cf7c-45ac-90b8-c2d72c6c9b65 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:05.794681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037179-c47f-4365-b06e-8c9b312366c9 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:05.819743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:05.820374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.820653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.820921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.821766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=9f5e493603104e09ac10fad9a8d68de4) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:05.822073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:05.823591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a431e-98b4-4853-8f0e-ec06fe414a17 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:05.830922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 94/174] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:05 2022] GET /identity/v3/role_assignments?user.id=9f5e493603104e09ac10fad9a8d68de4&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:05.831312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c6712-e752-4f9f-9313-1d799571bbcf None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.831598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c6712-e752-4f9f-9313-1d799571bbcf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.831873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c6712-e752-4f9f-9313-1d799571bbcf None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.833249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 95/175] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:05.840543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:05.840943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.841233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.841345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:05.841500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.841599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:05.841869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:05.871991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:05.872185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:05.873203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:05.879779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:05.880699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:05.881934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 81/176] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:05.886955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:05.973347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 96/177] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:06.014630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.090928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ac688-cee7-4a27-8fba-14bea41f518e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.136661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc1482-6d78-4417-8bb7-f8d1d515cc8c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.146617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.147732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.148240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.148727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.149758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:06.150284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.151954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdad79-44c8-4efa-a5ba-c1dd74611339 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.166815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 82/178] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:06.168206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58fbb6-4ac6-4791-a5a0-6dbf3dd2e4b8 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.168491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58fbb6-4ac6-4791-a5a0-6dbf3dd2e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.168763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58fbb6-4ac6-4791-a5a0-6dbf3dd2e4b8 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.170286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 83/179] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:06.172789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58fbb6-4ac6-4791-a5a0-6dbf3dd2e4b8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.188400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3e1dc-c7b2-42bf-8d0f-902a82be0a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.189234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3e1dc-c7b2-42bf-8d0f-902a82be0a98 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.189518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3e1dc-c7b2-42bf-8d0f-902a82be0a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.189790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3e1dc-c7b2-42bf-8d0f-902a82be0a98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.212879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3e1dc-c7b2-42bf-8d0f-902a82be0a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-41f3e1dc-c7b2-42bf-8d0f-902a82be0a98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:06.222488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:06.223518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:06.224331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:06.224949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 97/180] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:06.225949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.226259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.226534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.250956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:06.252910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:06.313207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58fbb6-4ac6-4791-a5a0-6dbf3dd2e4b8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.342584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 98/181] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:06.343977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.354567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.355519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.355795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.356062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] PATH_INFO: `/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.357319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] RBAC: Authorizing `identity:get_user(user_id=86e9df2ea0c64543b814c1aa6b7b6b95)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.358822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.360922 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 84/182] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/users/86e9df2ea0c64543b814c1aa6b7b6b95 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:06.365794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.460927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76582-ff34-416f-8805-c85d782f4f92 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.468420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0828e3-b773-4a36-b7c8-7029a9cac694 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.493699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.494367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.494644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.494940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.495710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:06.495986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.497398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.500409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.501061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.501338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.501608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.507179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 99/183] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:06.512220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.573711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.575603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.612536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac95afc-b97e-411c-9af2-951aa363d3a2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.644933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aa944-5dde-47f7-8c39-b11ee92dca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.645742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa944-5dde-47f7-8c39-b11ee92dca31 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.646024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa944-5dde-47f7-8c39-b11ee92dca31 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.646297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aa944-5dde-47f7-8c39-b11ee92dca31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.647633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa944-5dde-47f7-8c39-b11ee92dca31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.649118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aa944-5dde-47f7-8c39-b11ee92dca31 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.656136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 100/184] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:06.656136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eccab-0eb3-44bf-9c0d-f812667d4687 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.656136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eccab-0eb3-44bf-9c0d-f812667d4687 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.656136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eccab-0eb3-44bf-9c0d-f812667d4687 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.656136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 101/185] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:06.656136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eccab-0eb3-44bf-9c0d-f812667d4687 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.684192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 85/186] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:02:06.684192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.753069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eccab-0eb3-44bf-9c0d-f812667d4687 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.781068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e354bb-270f-4ed7-a83a-dae1cf574837 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.786857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a942b-b846-4065-8705-77aedea0e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.787800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a942b-b846-4065-8705-77aedea0e73e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.788083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a942b-b846-4065-8705-77aedea0e73e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.788352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a942b-b846-4065-8705-77aedea0e73e None admin] PATH_INFO: `/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.801447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a942b-b846-4065-8705-77aedea0e73e None admin] RBAC: Authorizing `identity:get_user(user_id=732d6d7ac4cb4b37ab7c2346c754e0e6)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.803029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a942b-b846-4065-8705-77aedea0e73e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.809022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 102/187] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:06.809022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.809022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.809022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.814089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.814751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.815071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.815340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.816050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.817522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.825978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:06.827534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:06.838650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 86/188] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:06 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:06.838650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.913162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 103/189] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:06.920409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:06.949397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de844f7f-6647-42ba-853f-6909e9d78f92 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:06.984632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:06.985578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:06.985860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:06.986132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] PATH_INFO: `/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:06.987402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] RBAC: Authorizing `identity:get_project(project_id=ce5d3dad7bfe40bfbc1fcfee12e07f67)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:06.988876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:06.990611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 87/190] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/projects/ce5d3dad7bfe40bfbc1fcfee12e07f67 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:06.991499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.042050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74cf4-59d8-48b2-a7a5-e760d74d7688 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.086186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f721db-7236-4b8a-824d-1683a0e64be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.086186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f721db-7236-4b8a-824d-1683a0e64be5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.086451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f721db-7236-4b8a-824d-1683a0e64be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.086713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f721db-7236-4b8a-824d-1683a0e64be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.100802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440c90-8e53-47fc-87da-6739dec475be None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.136825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.137651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.137932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.138202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.151003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:07.161749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:07.162671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:07.163546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 88/191] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:07.164226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.167815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f721db-7236-4b8a-824d-1683a0e64be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:07.169447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f721db-7236-4b8a-824d-1683a0e64be5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:07.282913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 104/192] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:07.282913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6640-c212-4ae3-a68a-106dd04c411a None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.282913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6640-c212-4ae3-a68a-106dd04c411a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.282913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb6640-c212-4ae3-a68a-106dd04c411a None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.285185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc58ec5-c2cf-40d1-af42-16bac928fd06 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.287828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 105/193] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:07.288416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6640-c212-4ae3-a68a-106dd04c411a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.328788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.329701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.330140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.330551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.332483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=ce5d3dad7bfe40bfbc1fcfee12e07f67, user.id=86e9df2ea0c64543b814c1aa6b7b6b95) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:07.332959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:07.334557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861660-e351-46e4-ae89-bb7c62672e52 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:07.342082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 89/194] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/role_assignments?user.id=86e9df2ea0c64543b814c1aa6b7b6b95&scope.project.id=ce5d3dad7bfe40bfbc1fcfee12e07f67&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:07.343662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.344146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.344642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.369916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:07.371157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:07.469437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb6640-c212-4ae3-a68a-106dd04c411a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.498523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 90/195] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:07.499428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.548604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.549290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.549569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.549839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.550605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:07.551434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:07.552846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:07.563090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 106/196] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:07.564344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.662077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb3baa-6ee2-40a8-96af-5a9b5f691d89 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.679425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50bdfb-8945-4c8f-aa6d-d433abdc6262 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.696513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.697293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.697573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.697846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.699064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:07.700547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:07.702257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 91/197] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:07.703040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.715594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.716770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.717272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.717751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.728704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:07.739088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:07.740076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:07.740883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:07.743470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 107/198] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:07.744474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.820894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053aaa-1dd4-4613-8f06-aa8bd57618e2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.857657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe53707-6d09-46b8-b5e3-7ba620307a34 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:07.863237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.864128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.864405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.864679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] PATH_INFO: `/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.865901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] RBAC: Authorizing `identity:get_user(user_id=732d6d7ac4cb4b37ab7c2346c754e0e6)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:07.867837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:07.869860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 92/199] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:07.870627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:07.908261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:07.908930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:07.909213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:07.909483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:07.910474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=732d6d7ac4cb4b37ab7c2346c754e0e6) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:07.910784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:07.912873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:07.919335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 108/200] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/role_assignments?user.id=732d6d7ac4cb4b37ab7c2346c754e0e6&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:07.920006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:08.061374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d5e2d-57ed-41d7-a5a6-3bc94f88a2b8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:08.129399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc185-20c6-4920-bd57-fe2007f57b05 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:08.137410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:08.138753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:08.139267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:08.139753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:08.140727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:08.141264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:08.142901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:08.154776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 93/201] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:08.159776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:08.186138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:08.187052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:08.187467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:08.188172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:08.300080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:08.301587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:08.370389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81882b86-3173-4a01-af8b-1dabf5937709 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:08.403370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 109/202] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:08.410922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:08.464148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:08.465037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:08.465319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:08.465590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] PATH_INFO: `/v3/users/bc4705733f6d45da80bf74aee6c2353c` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:08.471574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] RBAC: Authorizing `identity:get_user(user_id=bc4705733f6d45da80bf74aee6c2353c)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:08.473018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:08.474660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 94/203] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:08 2022] GET /identity/v3/users/bc4705733f6d45da80bf74aee6c2353c => generated 289 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:08.479986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:08.505182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93477d5-091f-4929-b38a-a89f1c7e7d72 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:08.538215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:08.539104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:08.539386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:08.539655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:08.540840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:08.542291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:08.544368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 110/204] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:08 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:08.550383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:08.658565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2f0b-f83c-416b-ae3c-e67add6446a2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:08.672807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c2be8-6ecc-4f4e-bab9-a170cead7635 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:08.697652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:08.698313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:08.698620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:08.699153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:08.699999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] RBAC: Adding query filter params (role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=732d6d7ac4cb4b37ab7c2346c754e0e6) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:08.700306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:08.701917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:08.707868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 111/205] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:08 2022] GET /identity/v3/role_assignments?user.id=732d6d7ac4cb4b37ab7c2346c754e0e6&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=85adb51ebde647209c75f54b8c949bdc => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:08.723550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:08.724638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:08.725110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:08.725574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:08.798265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:08.800118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:08.906791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 95/206] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:02:08.914991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:09.021514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82225ad-b5b3-46e0-a284-93d9898279d6 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:09.055608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4a323-3496-42cd-b893-19643977a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:09.056482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4a323-3496-42cd-b893-19643977a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.056760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4a323-3496-42cd-b893-19643977a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.057035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4a323-3496-42cd-b893-19643977a4e1 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.058218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4a323-3496-42cd-b893-19643977a4e1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:09.059705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4a323-3496-42cd-b893-19643977a4e1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:09.061839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 112/207] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:08 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:09.067331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:09.233369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e7db9-bf65-4189-9c7f-4ad0b638ff61 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:09.282589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:09.283673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.284149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.284635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.285698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] RBAC: Adding query filter params (role.id=5ababcfa963a4528801ab31a5847a2f2, scope.project.id=6a34e27a9e9c4905968993041711ccdb, user.id=bc4705733f6d45da80bf74aee6c2353c) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:09.286233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:09.287932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a4602-25c1-4534-a679-4d6a3e97b37f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:09.295434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 96/208] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:09 2022] GET /identity/v3/role_assignments?user.id=bc4705733f6d45da80bf74aee6c2353c&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=5ababcfa963a4528801ab31a5847a2f2 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:09.636428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c086-b405-4c0b-9d28-7b0c5749b4cb None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.636760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c086-b405-4c0b-9d28-7b0c5749b4cb None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.637081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c086-b405-4c0b-9d28-7b0c5749b4cb None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.638653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 113/209] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:09.644194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c139-c176-4c2b-9cdc-d44f428068cc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.644729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c139-c176-4c2b-9cdc-d44f428068cc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.645222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284c139-c176-4c2b-9cdc-d44f428068cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.666395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a284c139-c176-4c2b-9cdc-d44f428068cc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:09.667923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a284c139-c176-4c2b-9cdc-d44f428068cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:09.736634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 97/210] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:09.765616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c086-b405-4c0b-9d28-7b0c5749b4cb None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:09.768198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7daa1-f1f9-4a45-bbfb-187b6fa0e717 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.768487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7daa1-f1f9-4a45-bbfb-187b6fa0e717 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.768763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7daa1-f1f9-4a45-bbfb-187b6fa0e717 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.775603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 98/211] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:09.782497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.783111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.783392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.803315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:09.804476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:09.888552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067c086-b405-4c0b-9d28-7b0c5749b4cb None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:09.892807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 99/212] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:09.921128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:09.922928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:09.923742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:09.924023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:09.924296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:09.925494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:09.926989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:09.928790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 114/213] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:09.935146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:10.040776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d154826-6668-4c59-9974-adde567b96f2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.047470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a5b1-ddbc-41b5-a53d-8e1f60d52e61 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.074788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:10.075930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.076385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.076840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.087650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:10.087770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:10.088351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.088626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.088893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.089596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:10.091079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:10.097038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:10.098038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:10.098924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:10.102036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 100/214] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:10.108337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:10.123816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 115/215] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:09 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:10.222665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38114e7a-cc2b-4066-a78f-f02dc0ff9346 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.263225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:10.263930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.264166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.264497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.265253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:10.265551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:10.267211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:10.276782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 101/216] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:10.282613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:10.389162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de77d3-a167-47a0-ad25-392915ee82cd None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.422932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0d2d1-7549-4b48-bd12-2c1f99415679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:10.423821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d2d1-7549-4b48-bd12-2c1f99415679 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.424094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d2d1-7549-4b48-bd12-2c1f99415679 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.424360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0d2d1-7549-4b48-bd12-2c1f99415679 None admin] PATH_INFO: `/v3/users/423b280006d143c4b148cfe6408ce237` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.438786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0d2d1-7549-4b48-bd12-2c1f99415679 None admin] RBAC: Authorizing `identity:get_user(user_id=423b280006d143c4b148cfe6408ce237)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:10.441465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0d2d1-7549-4b48-bd12-2c1f99415679 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:10.444952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 116/217] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:10 2022] GET /identity/v3/users/423b280006d143c4b148cfe6408ce237 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:10.450689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:10.513851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8f98-604d-444f-b31c-dd3f000f1957 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.514131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8f98-604d-444f-b31c-dd3f000f1957 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.514326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8f98-604d-444f-b31c-dd3f000f1957 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.515950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 117/218] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:10.521474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.521762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.522036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.539465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:10.540622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:10.566590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a01d-9347-45d9-b2b0-8878e56e7035 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.602116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:10.602817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.603121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.603391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.629038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 118/219] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:10.652602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:10.679818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:10.681297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:10.819204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9e3a0-5f52-4cfd-9006-a6fdcd00140c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.854434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 102/220] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:10.860417 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:10.908246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:10.909326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:10.909741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:10.910141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:10.947540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:10.955366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:10.956228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:10.957021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:10.963035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 119/221] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:10.971219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820693e-bcd6-47aa-9dfe-3a3e42f57a87 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:10.971843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.010795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.011682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.011963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.012236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.018940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.020474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.023363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 103/222] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:10 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:11.032355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.120597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ef58a-d04d-40ee-b075-dedf5d67a800 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.153379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.154065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.154349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.154636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.155524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:11.155829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.157322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c58b2-d418-4121-83f6-f2c23b85de9f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.165574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 120/223] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:11.166945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1c45-3901-439d-83a1-ca965e89d6a3 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.167236 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1c45-3901-439d-83a1-ca965e89d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.167508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1c45-3901-439d-83a1-ca965e89d6a3 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.168799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 121/224] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:11.174006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1c45-3901-439d-83a1-ca965e89d6a3 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.197155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594aac25-6108-49ef-873b-94c14288e638 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.238066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.238727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.239082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.239354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.240676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=423b280006d143c4b148cfe6408ce237) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:11.241041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.243020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581f1d-3f0c-4a1a-9d51-b7621726790c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.252910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 104/225] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:11 2022] GET /identity/v3/role_assignments?user.id=423b280006d143c4b148cfe6408ce237&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:11.260111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.260399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.260676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.291248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:11.292522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:11.303354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1c45-3901-439d-83a1-ca965e89d6a3 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.349611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.350507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.350786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.351081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] PATH_INFO: `/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.353758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] RBAC: Authorizing `identity:get_user(user_id=732d6d7ac4cb4b37ab7c2346c754e0e6)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.356176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.357805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 122/226] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:11 2022] GET /identity/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:11.368207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.409771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 105/227] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:11.435979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.561128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc95a4-b845-4f12-b990-c048f180b885 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.597598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.598413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.598688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.598984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.610541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:11.618581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fb2b9-7e23-47c4-81df-73f6baed3767 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:11.619732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:11.620593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:11.621491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 106/228] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:11.628117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.664576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.665378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.665658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.665930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.667494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.668725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.672246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 123/229] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:11 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:11.686903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.764196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04210534-97bd-4eb6-900f-4af255496a05 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.804474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.806169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.806453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.806726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.808641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:11.808950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.811076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.828657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 107/230] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:11.835843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:11.877989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911d9ce-abf5-439d-ab43-b5b43225cc7c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:11.916741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:11.917860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:11.918280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:11.918700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/732d6d7ac4cb4b37ab7c2346c754e0e6/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:11.921058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] RBAC: Authorizing `identity:create_grant(project_id=a54ac5cae8c247e594fd4b678694455e, user_id=732d6d7ac4cb4b37ab7c2346c754e0e6, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:11.923233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:11.940023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 124/231] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:11 2022] PUT /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/732d6d7ac4cb4b37ab7c2346c754e0e6/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:11.996575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8febf36-dc5c-45f1-9b04-73a1f0fdbd62 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:12.044582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:12.045486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:12.045767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:12.046038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] PATH_INFO: `/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:12.047417 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=732d6d7ac4cb4b37ab7c2346c754e0e6)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:12.049072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:12.051152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 108/232] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:11 2022] GET /identity/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:12.057584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:12.193678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba097ceb-d23a-4680-bbe4-6104de1be7ff None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:12.230790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020559-980a-4df6-a2d9-167737d7704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:12.231707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020559-980a-4df6-a2d9-167737d7704c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:12.231980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020559-980a-4df6-a2d9-167737d7704c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:12.232244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020559-980a-4df6-a2d9-167737d7704c None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:12.233434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f020559-980a-4df6-a2d9-167737d7704c None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:12.235027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f020559-980a-4df6-a2d9-167737d7704c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:12.237112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 125/233] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:12 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:12.242675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:12.393672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efed64e-9efa-4f79-95da-f15c65b65ec6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:12.440925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2696aa-9fd5-4ab4-b5b6-b6546e8ccfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:12.441823 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2696aa-9fd5-4ab4-b5b6-b6546e8ccfbc None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:12.442099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2696aa-9fd5-4ab4-b5b6-b6546e8ccfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:12.442367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2696aa-9fd5-4ab4-b5b6-b6546e8ccfbc None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/732d6d7ac4cb4b37ab7c2346c754e0e6/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:12.448221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2696aa-9fd5-4ab4-b5b6-b6546e8ccfbc None admin] RBAC: Authorizing `identity:create_grant(project_id=a54ac5cae8c247e594fd4b678694455e, user_id=732d6d7ac4cb4b37ab7c2346c754e0e6, role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:12.449631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2696aa-9fd5-4ab4-b5b6-b6546e8ccfbc None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:12.469759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 109/234] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:12 2022] PUT /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/732d6d7ac4cb4b37ab7c2346c754e0e6/roles/85adb51ebde647209c75f54b8c949bdc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:13.020290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875106-860d-4138-8fd9-6b3f75a3a455 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.020590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875106-860d-4138-8fd9-6b3f75a3a455 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.021059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875106-860d-4138-8fd9-6b3f75a3a455 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.023064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 126/235] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:13.028718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ad263-244f-4292-9c38-ad0929ac0183 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.029235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ad263-244f-4292-9c38-ad0929ac0183 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.029681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ad263-244f-4292-9c38-ad0929ac0183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.055129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-0e8ad263-244f-4292-9c38-ad0929ac0183 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:13.056608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0e8ad263-244f-4292-9c38-ad0929ac0183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:13.146092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 110/236] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:13.184350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65875106-860d-4138-8fd9-6b3f75a3a455 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:13.204403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba29cfe-7f5c-47ec-a095-7749baa4afa5 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.204909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba29cfe-7f5c-47ec-a095-7749baa4afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.205323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba29cfe-7f5c-47ec-a095-7749baa4afa5 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.206844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 111/237] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:13.224386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.224925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.225356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.258149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:13.259348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:13.360670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65875106-860d-4138-8fd9-6b3f75a3a455 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:13.363958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 112/238] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:13.428937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:13.429743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.430022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.430289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.438841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:13.443036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:13.454912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:13.455845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:13.456662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 127/239] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:13.458424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:13.601516 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc9c46-ef89-4be1-90a4-205b716cdb5d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:13.642172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3603a4-f8d7-4134-84cb-352720b5fe37 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:13.653878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:13.654972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.655467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.655933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.656930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:13.657429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:13.659069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:13.674358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 128/240] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:13.680688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:13.706658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:13.708645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.709908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.710389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.713119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:13.714778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:13.717363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 113/241] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:13.723887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:13.852092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92097-d276-4b52-a5ae-75869657bde5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:13.858950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a3a70-7340-4ac5-b865-c8c61081d935 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:13.886018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0944c-e01c-4833-8b62-fb838b9103af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:13.887244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0944c-e01c-4833-8b62-fb838b9103af None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.887747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0944c-e01c-4833-8b62-fb838b9103af None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.888215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0944c-e01c-4833-8b62-fb838b9103af None admin] PATH_INFO: `/v3/users/e2c2e125ff274c7c8ff4105820005897` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.893587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f743716-daa6-4f0b-8b22-61c04b43fe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:13.894222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f743716-daa6-4f0b-8b22-61c04b43fe3e None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.894502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f743716-daa6-4f0b-8b22-61c04b43fe3e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.894771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f743716-daa6-4f0b-8b22-61c04b43fe3e None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.895543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f743716-daa6-4f0b-8b22-61c04b43fe3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:13.896979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f743716-daa6-4f0b-8b22-61c04b43fe3e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:13.904214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0944c-e01c-4833-8b62-fb838b9103af None admin] RBAC: Authorizing `identity:get_user(user_id=e2c2e125ff274c7c8ff4105820005897)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:13.905905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0944c-e01c-4833-8b62-fb838b9103af None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:13.908224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 129/242] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:13 2022] GET /identity/v3/users/e2c2e125ff274c7c8ff4105820005897 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:13.909873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d546d53-e35f-45f3-b683-da70104ec415 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.910233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d546d53-e35f-45f3-b683-da70104ec415 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.910531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d546d53-e35f-45f3-b683-da70104ec415 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.914925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 130/243] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:13.917074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d546d53-e35f-45f3-b683-da70104ec415 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:13.926751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 114/244] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:13 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:13.928587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:13.929136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:13.929605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:13.949302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:13.950872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:14.023100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 115/245] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:14.048158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.056021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d546d53-e35f-45f3-b683-da70104ec415 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.131023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.132114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.133582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.134167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.202056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c11be-472b-46c9-bc87-8b2ed4b72ed1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.216854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:14.219110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:14.239153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.240194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.240617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.241058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.251854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:14.259894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:14.260804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:14.261606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:14.263775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 116/246] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:14.269815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.326357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 131/247] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:14.327637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.373809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6850542-5daf-4c31-8b81-fa03de7c8db0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.412255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.413013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.413295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.413564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.414314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:14.414621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:14.416490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:14.437210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 117/248] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:14.446554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.452894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e5153-d6da-4974-b22f-ee5b666e6a30 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.496879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.498006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.498426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.498835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.500375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:14.502048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:14.508603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 132/249] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:14.510964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.574339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af4de-ca2d-4eb6-8ab4-ecb1358b255b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.611999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.613158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.613586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.614005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] PATH_INFO: `/v3/users/423b280006d143c4b148cfe6408ce237` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.615287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32160-f6f9-42fe-9029-23a5c5061bae None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.615592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=423b280006d143c4b148cfe6408ce237)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:14.617236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:14.623401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 118/250] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/users/423b280006d143c4b148cfe6408ce237 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:14.629950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.650209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.651783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.651783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.651783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.652676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] RBAC: Adding query filter params (role.id=5ababcfa963a4528801ab31a5847a2f2, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=e2c2e125ff274c7c8ff4105820005897) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:14.653048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:14.654596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb41627-cee0-4d1d-a5f8-3c85f86c8bc0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:14.660674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 133/251] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/role_assignments?user.id=e2c2e125ff274c7c8ff4105820005897&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=5ababcfa963a4528801ab31a5847a2f2 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:14.704459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21c7d0-0ee2-4fb3-a895-d1be7c086afb None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.704627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21c7d0-0ee2-4fb3-a895-d1be7c086afb None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.705006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21c7d0-0ee2-4fb3-a895-d1be7c086afb None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.706769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 134/252] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:14.712038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.712327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.712605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.739313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:14.740515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:14.743831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2adfb-c6ed-4114-8df9-ece5d1423cb2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:14.813344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:14.814591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:14.815091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:14.817953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:14.822152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:14.823979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:14.828945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 119/253] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:14.834844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.882050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 135/254] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:14.931778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:14.963443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c62da-2a5f-478e-b71a-c60ff64cc6f7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:15.000024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:15.001282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.001787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.002248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/423b280006d143c4b148cfe6408ce237/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.004776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] RBAC: Authorizing `identity:create_grant(project_id=a54ac5cae8c247e594fd4b678694455e, user_id=423b280006d143c4b148cfe6408ce237, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:15.006433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:15.029494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 120/255] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:14 2022] PUT /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/423b280006d143c4b148cfe6408ce237/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:02:15.117260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff63f9d-1155-4b5b-9cb9-aadbb0cd8c7e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:15.162574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:15.163429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.163706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.163975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.176250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:15.184274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:15.185237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:15.186042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 136/256] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:15.191992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:15.325161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00839573-c548-466f-9f0b-f23c56afa614 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:15.360496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:15.361516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.361964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.362401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.363378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:15.363850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:15.365425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c16b-fcf5-477f-9630-5c81299f7cb6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:15.376175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 121/257] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:15.381593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:15.387338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5afd6-8f18-4f68-8ed3-ab9d135f9256 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.387847 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5afd6-8f18-4f68-8ed3-ab9d135f9256 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.388270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5afd6-8f18-4f68-8ed3-ab9d135f9256 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.389844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 122/258] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:15.395861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.396137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.396416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.424007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:15.425222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:15.528534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 123/259] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:15.535260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a1fe8-d207-4116-a5c7-a83e859bad54 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:15.556711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:15.570241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:15.571151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.571423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.571690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] PATH_INFO: `/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.573275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=732d6d7ac4cb4b37ab7c2346c754e0e6)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:15.574916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:15.577522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 137/260] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:15 2022] GET /identity/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:15.582524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:15.761507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10911dea-f427-4b57-b341-27eefdfe7bd5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:15.764731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bc5c-6930-44f3-b979-2b8ac2c4b0f0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:15.836450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:15.837021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.837300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.837570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.838731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:15.839559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:15.839827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:15.840087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:15.869593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:15.886113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:15.888214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:15.890144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 124/261] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:15.897906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:15.970837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:15.972362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:16.069448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 138/262] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:16.075592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:16.105917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7771ae-9dad-40f6-a674-3e2a8fd510df None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:16.171954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:16.172653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:16.172934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:16.173209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:16.173980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:16.174285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:16.175731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:16.198733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 125/263] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:16.204218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:16.258534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f4e9f-b1aa-45f7-aa39-8ba8e786fa90 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:16.302854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:16.303760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:16.304042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:16.304314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:16.305562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:16.307097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:16.309228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 139/264] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:16 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:16.315760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:16.401752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dcab6-82fb-402c-a6e5-98eacf2be10f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:16.457635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92153284-237c-4844-a841-f6bd60e29e58 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:16.491868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:16.492521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:16.492802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:16.493075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:16.493909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=732d6d7ac4cb4b37ab7c2346c754e0e6) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:16.494223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:16.495813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:16.496136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:16.497024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:16.497295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:16.497566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] PATH_INFO: `/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:16.501849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 140/265] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:16 2022] GET /identity/v3/role_assignments?user.id=732d6d7ac4cb4b37ab7c2346c754e0e6&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:16.507091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] RBAC: Authorizing `identity:get_user(user_id=732d6d7ac4cb4b37ab7c2346c754e0e6)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:16.507091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:16.507091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 126/266] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:16 2022] GET /identity/v3/users/732d6d7ac4cb4b37ab7c2346c754e0e6 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:16.512505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:16.627885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28ce28-36de-48c7-ad45-36233f9c9136 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:16.663137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:16.664072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:16.664495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:16.664909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:16.745751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:16.747531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:16.851023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 141/267] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:16.857166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:17.074675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41aab8-37a9-48a9-8ba5-5bdbb96d2159 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:17.113475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad8a9c-8570-4023-9460-745de23554f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:17.114342 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8a9c-8570-4023-9460-745de23554f8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.114621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8a9c-8570-4023-9460-745de23554f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.114906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad8a9c-8570-4023-9460-745de23554f8 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.116966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad8a9c-8570-4023-9460-745de23554f8 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:17.118414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad8a9c-8570-4023-9460-745de23554f8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:17.120456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 127/268] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:16 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:17.127002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:17.262318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea3cce-8ea8-4624-9e67-20e89a09406e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:17.307125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:17.307786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.308060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.308328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.309161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] RBAC: Adding query filter params (role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=732d6d7ac4cb4b37ab7c2346c754e0e6) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:17.309462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:17.310926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21849-aed1-4e99-8515-38d1a5739050 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:17.323914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 142/269] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:17 2022] GET /identity/v3/role_assignments?user.id=732d6d7ac4cb4b37ab7c2346c754e0e6&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=85adb51ebde647209c75f54b8c949bdc => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:17.608841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db599e-9e0b-4079-bc23-123b9bce0849 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.609213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db599e-9e0b-4079-bc23-123b9bce0849 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.609421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db599e-9e0b-4079-bc23-123b9bce0849 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.610979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 128/270] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:17.617041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dfcf3-c6be-4537-9080-8b83c2c46c16 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.617571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dfcf3-c6be-4537-9080-8b83c2c46c16 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.617571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dfcf3-c6be-4537-9080-8b83c2c46c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.643985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ce5dfcf3-c6be-4537-9080-8b83c2c46c16 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:17.645231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ce5dfcf3-c6be-4537-9080-8b83c2c46c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:17.716651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 143/271] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:17.740092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db599e-9e0b-4079-bc23-123b9bce0849 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:17.804325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2934ca-6ee9-4fba-a405-3e305e04282e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.804636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2934ca-6ee9-4fba-a405-3e305e04282e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.804871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2934ca-6ee9-4fba-a405-3e305e04282e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.806231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 144/272] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:17.812286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.812720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.812986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.831509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:17.833143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:17.872833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db599e-9e0b-4079-bc23-123b9bce0849 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:17.923790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:17.924832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:17.925277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:17.925697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:17.927045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 145/273] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:17.939120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:17.945999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:17.951013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:17.952163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:17.953299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:17.956222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 129/274] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:17.963994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.051357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe279b-f197-48f2-9e0d-feecbe88f653 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.064379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194038-76c6-41fe-ae75-6e257ecc83d3 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.085325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12399-4b5e-4c19-b018-4b8e849c0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.086289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12399-4b5e-4c19-b018-4b8e849c0600 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.086570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12399-4b5e-4c19-b018-4b8e849c0600 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.086837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12399-4b5e-4c19-b018-4b8e849c0600 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.098088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12399-4b5e-4c19-b018-4b8e849c0600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:18.100436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.101477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.101758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.102027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.103179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:18.103699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.105133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaeae06-30e5-44d9-aed3-1f0bdec6b5be None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-ccc12399-4b5e-4c19-b018-4b8e849c0600 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:18.107483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:18.108393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:18.109274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 146/275] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:18.110584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9efca-2cc4-47f9-a4e2-295d8d4cf098 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.110584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9efca-2cc4-47f9-a4e2-295d8d4cf098 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.110862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9efca-2cc4-47f9-a4e2-295d8d4cf098 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.116046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 147/276] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:18.116046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9efca-2cc4-47f9-a4e2-295d8d4cf098 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.120183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 130/277] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:18.124563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.124563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.124563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.140337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:18.141644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:18.204388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 131/278] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:18.205246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.216272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9efca-2cc4-47f9-a4e2-295d8d4cf098 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.250543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.251231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.251508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.251778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.252534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:18.252836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.254218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1741d0-af24-4e75-a399-61c958f976ae None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.262513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 148/279] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:18.263762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63aee0-b50a-4d2e-8faa-e7b2b6b86983 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.264072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63aee0-b50a-4d2e-8faa-e7b2b6b86983 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.264344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63aee0-b50a-4d2e-8faa-e7b2b6b86983 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.265631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 149/280] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:18.266366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63aee0-b50a-4d2e-8faa-e7b2b6b86983 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.306776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e95c7-6f47-4e85-89fb-f58a22481edb None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.339896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.340763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.341014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.341270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] PATH_INFO: `/v3/users/31df7c8aaaad4e439ff83e39ef0834ef` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.353989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=31df7c8aaaad4e439ff83e39ef0834ef)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.355463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.357092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 132/281] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/users/31df7c8aaaad4e439ff83e39ef0834ef => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:18.357092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.361999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63aee0-b50a-4d2e-8faa-e7b2b6b86983 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.396370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c6bb0-da08-4f20-910a-bd4d4f0e8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.397181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6bb0-da08-4f20-910a-bd4d4f0e8dac None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.397480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6bb0-da08-4f20-910a-bd4d4f0e8dac None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.397752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6bb0-da08-4f20-910a-bd4d4f0e8dac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.398997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c6bb0-da08-4f20-910a-bd4d4f0e8dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.400415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c6bb0-da08-4f20-910a-bd4d4f0e8dac None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.402191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 150/282] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:18.403200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.403481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.403755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.419695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:18.420868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:18.459974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab0af5-4554-424e-8bab-a41c94f1d8d1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.482139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 151/283] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:18.482971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.492909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.493795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.494066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.494334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] PATH_INFO: `/v3/users/e2c2e125ff274c7c8ff4105820005897` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.495520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] RBAC: Authorizing `identity:get_user(user_id=e2c2e125ff274c7c8ff4105820005897)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.496959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.498705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 133/284] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/users/e2c2e125ff274c7c8ff4105820005897 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:18.499317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.596331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4442-5b05-4ab4-b565-fbaf27194b0a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.598752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ef54b-e0fa-4503-a129-0bdb05ddbe64 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.630968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.631660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.631939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.632035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.632471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.632604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.632876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.632964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.633144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.633956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, user.id=31df7c8aaaad4e439ff83e39ef0834ef, scope.system=all) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:18.634263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.634359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.635708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.640615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 152/285] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/role_assignments?user.id=31df7c8aaaad4e439ff83e39ef0834ef&scope.system=all&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:18.641371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.658935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 134/286] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:18 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:18.659771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.754569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8ffbf-dede-4b78-a363-e895834f13ad None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.772104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22df1a-429b-4bff-b84a-83442ed0599a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.799440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.800770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.801302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.801791 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.803407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.805098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.807455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 153/287] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:18.814930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.815144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.815226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.815226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.815226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.833926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:18.841966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:18.843157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:18.844224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:18.848534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 135/288] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:18.849445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:18.927377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5d46-d24e-498a-9a22-5d24b3ea6ddc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.965217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:18.966846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:18.966846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:18.966846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/e2c2e125ff274c7c8ff4105820005897/roles/5ababcfa963a4528801ab31a5847a2f2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:18.970361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] RBAC: Authorizing `identity:create_grant(project_id=a54ac5cae8c247e594fd4b678694455e, user_id=e2c2e125ff274c7c8ff4105820005897, role_id=5ababcfa963a4528801ab31a5847a2f2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:18.973959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:18.989051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8e046-1038-4cb5-ae1e-d2c3d6e8e03a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:18.993106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 154/289] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:18 2022] PUT /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e/users/e2c2e125ff274c7c8ff4105820005897/roles/5ababcfa963a4528801ab31a5847a2f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:19.030124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:19.030814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:19.031181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:19.031453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:19.032223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:19.032525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:19.033964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:19.043487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 136/290] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:19.049313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:19.160774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd165-deca-4ca5-960b-6b7067c3118c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:19.198013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:19.198926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:19.199214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:19.199487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] PATH_INFO: `/v3/users/423b280006d143c4b148cfe6408ce237` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:19.200781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] RBAC: Authorizing `identity:get_user(user_id=423b280006d143c4b148cfe6408ce237)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:19.202356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:19.204497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 155/291] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:19 2022] GET /identity/v3/users/423b280006d143c4b148cfe6408ce237 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:19.209875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:19.324524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8bf5b-d288-4a58-88e5-02e7665e8ad3 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:19.357658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:19.358307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:19.358639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:19.358933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:19.425934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:19.427370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:19.524491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 137/292] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:19.530108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:19.634208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477e1bc-c978-4c76-8f43-6cdf6c8d82a8 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:19.674554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84951-21f9-4de6-8b6d-1249c6237792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:19.675795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84951-21f9-4de6-8b6d-1249c6237792 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:19.676119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84951-21f9-4de6-8b6d-1249c6237792 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:19.676343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84951-21f9-4de6-8b6d-1249c6237792 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:19.677537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff84951-21f9-4de6-8b6d-1249c6237792 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:19.679042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff84951-21f9-4de6-8b6d-1249c6237792 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:19.681341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 156/293] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:19 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:19.692035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:19.803964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea5e53-b6e1-4dd3-969a-7a52d07a9965 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:19.844096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:19.845138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:19.845643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:19.846110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:19.847171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=423b280006d143c4b148cfe6408ce237) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:19.847680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:19.849374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23898-04e3-4cca-a655-eee9892b55ef None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:19.856154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 138/294] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:19 2022] GET /identity/v3/role_assignments?user.id=423b280006d143c4b148cfe6408ce237&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:21.169573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907da9f5-b714-4b19-88ee-86ec1faf50b2 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.170102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907da9f5-b714-4b19-88ee-86ec1faf50b2 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.170102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907da9f5-b714-4b19-88ee-86ec1faf50b2 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.171926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 157/295] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:21.178203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd872-b427-4d12-8455-014862746d33 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.178724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd872-b427-4d12-8455-014862746d33 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.178800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573dd872-b427-4d12-8455-014862746d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.198131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-573dd872-b427-4d12-8455-014862746d33 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:21.199370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-573dd872-b427-4d12-8455-014862746d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:21.269433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 139/296] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:21.292343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907da9f5-b714-4b19-88ee-86ec1faf50b2 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.375619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584da81-81a2-4854-8b38-5af8b6426f3d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.375962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584da81-81a2-4854-8b38-5af8b6426f3d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.376158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584da81-81a2-4854-8b38-5af8b6426f3d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.377786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 140/297] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:21.382943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71995e6-66f7-4073-b0cd-e0c501a5d151 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.383227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71995e6-66f7-4073-b0cd-e0c501a5d151 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.383497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71995e6-66f7-4073-b0cd-e0c501a5d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.400245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c71995e6-66f7-4073-b0cd-e0c501a5d151 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:21.401623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c71995e6-66f7-4073-b0cd-e0c501a5d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:21.402355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907da9f5-b714-4b19-88ee-86ec1faf50b2 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:21.447834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:21.448566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.448839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.449104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.460871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:21.469051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:21.471080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:21.472152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 158/298] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:21.476838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.490677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 141/299] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:21.513667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd147df-de05-497f-9faf-6dd9c934535c None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.513958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd147df-de05-497f-9faf-6dd9c934535c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.514229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd147df-de05-497f-9faf-6dd9c934535c None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.515662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 142/300] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:21.516341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd147df-de05-497f-9faf-6dd9c934535c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.580431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c517df-9cff-4f51-9734-d7cb2cdc7dbe None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:21.614841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:21.615536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.615818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.616096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.616838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:21.617138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:21.618517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d86c-365b-422d-935b-8d08fd232302 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:21.620421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd147df-de05-497f-9faf-6dd9c934535c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:21.626943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 159/301] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:21.631521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac2d4d-71b4-476c-ad59-e6007eb1ae53 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.631885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac2d4d-71b4-476c-ad59-e6007eb1ae53 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.632166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac2d4d-71b4-476c-ad59-e6007eb1ae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.648220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-dbac2d4d-71b4-476c-ad59-e6007eb1ae53 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:21.649386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-dbac2d4d-71b4-476c-ad59-e6007eb1ae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:21.653426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:21.654222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.654505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.654774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.665861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:21.673546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:21.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 143/302] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:21.675632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.719581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 160/303] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:21.720822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874b9c-77f8-4d61-99a6-6e00b98cc820 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.721107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874b9c-77f8-4d61-99a6-6e00b98cc820 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.721352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874b9c-77f8-4d61-99a6-6e00b98cc820 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.722604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 161/304] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:21.726691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09874b9c-77f8-4d61-99a6-6e00b98cc820 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.780165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533872d3-b6d4-4d2b-bdfa-3df27f64eae3 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:21.813187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f531d48-a9ce-4d59-b079-be6f6ee0c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:21.814059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f531d48-a9ce-4d59-b079-be6f6ee0c739 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.814332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f531d48-a9ce-4d59-b079-be6f6ee0c739 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.814602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f531d48-a9ce-4d59-b079-be6f6ee0c739 None admin] PATH_INFO: `/v3/users/31df7c8aaaad4e439ff83e39ef0834ef` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.815853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f531d48-a9ce-4d59-b079-be6f6ee0c739 None admin] RBAC: Authorizing `identity:get_user(user_id=31df7c8aaaad4e439ff83e39ef0834ef)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:21.817302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f531d48-a9ce-4d59-b079-be6f6ee0c739 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:21.819409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 144/305] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:21 2022] GET /identity/v3/users/31df7c8aaaad4e439ff83e39ef0834ef => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:21.820359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.820635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.820901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.824145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09874b9c-77f8-4d61-99a6-6e00b98cc820 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:21.836961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:21.838124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:21.860234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:21.860883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:21.861162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:21.861437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:21.862177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:21.862472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:21.863885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:21.871841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 162/306] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:21.872606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.900892 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 145/307] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:21.901698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:21.970254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c8a9-db4c-4d59-bf3a-6ea11588f005 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:21.996442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5b37-49af-467d-98df-76ce123e0210 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.004264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.005053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.005326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.005592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.006820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.008299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.009863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 163/308] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:22.010598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.033112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.033987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.034286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.034554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] PATH_INFO: `/v3/system/users/31df7c8aaaad4e439ff83e39ef0834ef/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.036087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=31df7c8aaaad4e439ff83e39ef0834ef, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.037471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.047305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 146/309] 10.222.0.59 () {58 vars in 1334 bytes} [Wed May 4 08:02:21 2022] PUT /identity/v3/system/users/31df7c8aaaad4e439ff83e39ef0834ef/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:22.048576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.114532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879bd16-4ab2-4d4e-8468-7cf85350cee8 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.150454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.151382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.151699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.151957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] PATH_INFO: `/v3/users/2f8c24b453894f579969b8c2672d5388` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.154394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d023df-d242-4750-b258-ef28e227a9c6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.167621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] RBAC: Authorizing `identity:get_user(user_id=2f8c24b453894f579969b8c2672d5388)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.169131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.170914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 164/310] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/users/2f8c24b453894f579969b8c2672d5388 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:22.171710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.198227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.199102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.199381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.199653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.210522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:22.218411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:22.219673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 147/311] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:22.225913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.273434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0be1c-2107-4eb5-a475-676959b5939f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.305841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.306502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.306774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.307067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] PATH_INFO: `/v3/groups` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.307742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.309162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.322899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269d7c5-ca02-4fe2-a0d3-7e153f1197e3 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.330812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 165/312] 10.222.0.59 () {60 vars in 1134 bytes} [Wed May 4 08:02:22 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:22.330812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.366414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.367112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.367388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.367653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.368494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] RBAC: Adding query filter params (role.id=5ababcfa963a4528801ab31a5847a2f2, user.id=2f8c24b453894f579969b8c2672d5388, scope.system=all) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:22.368796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.370333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.376654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 148/313] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/role_assignments?user.id=2f8c24b453894f579969b8c2672d5388&scope.system=all&role.id=5ababcfa963a4528801ab31a5847a2f2 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:22.442056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467624f-1baa-469e-864e-6278fd6ade16 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.481188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.481788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.482066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.482335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.483131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:22.483434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.484924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.495230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 166/314] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:22.501071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.611391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f63098-4fcb-460b-85ec-8e0e692b1908 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.644522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.645642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.646064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.646476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] PATH_INFO: `/v3/users/e2c2e125ff274c7c8ff4105820005897` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.647868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] RBAC: Authorizing `identity:get_user(user_id=e2c2e125ff274c7c8ff4105820005897)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.649456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.651551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 149/315] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/users/e2c2e125ff274c7c8ff4105820005897 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:22.657489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:22.759564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63235-cda3-4940-abb3-d1b7203b46c1 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:22.792956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:22.793608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:22.793888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:22.794161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:22.861437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:22.862936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:22.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 167/316] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:22.969637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:23.068380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350caab-7c0f-47e7-af70-8ab29d9fa4bc None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:23.101287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1802-c4e2-48aa-84e8-5705ebf5bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:23.102147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1802-c4e2-48aa-84e8-5705ebf5bec1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:23.102417 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1802-c4e2-48aa-84e8-5705ebf5bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:23.102677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1802-c4e2-48aa-84e8-5705ebf5bec1 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:23.103897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1802-c4e2-48aa-84e8-5705ebf5bec1 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:23.105320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1802-c4e2-48aa-84e8-5705ebf5bec1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:23.107315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 150/317] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:22 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:23.113061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:23.218458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab51f8-9013-4289-92e2-166d9852ca6c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:23.253627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:23.254618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:23.255137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:23.255598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:23.256616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] RBAC: Adding query filter params (role.id=5ababcfa963a4528801ab31a5847a2f2, scope.project.id=a54ac5cae8c247e594fd4b678694455e, user.id=e2c2e125ff274c7c8ff4105820005897) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:23.257130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:23.258768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01566f-dc1d-4d01-93a5-c440e522bfe4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:23.265408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 168/318] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:23 2022] GET /identity/v3/role_assignments?user.id=e2c2e125ff274c7c8ff4105820005897&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=5ababcfa963a4528801ab31a5847a2f2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:24.300199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c5817-734f-459d-a19c-ac6537fdfa16 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.300740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c5817-734f-459d-a19c-ac6537fdfa16 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.300740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c5817-734f-459d-a19c-ac6537fdfa16 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.302291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 151/319] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:24.307631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.308043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.308213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.325557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:24.326741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:24.393689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 169/320] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:24.417529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c5817-734f-459d-a19c-ac6537fdfa16 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:24.526568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c5817-734f-459d-a19c-ac6537fdfa16 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:24.561912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d9ca0-f918-4d29-a682-2ce7118fb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:24.562713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9ca0-f918-4d29-a682-2ce7118fb5cd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.563028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9ca0-f918-4d29-a682-2ce7118fb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.563281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d9ca0-f918-4d29-a682-2ce7118fb5cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.573659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d9ca0-f918-4d29-a682-2ce7118fb5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-2b7d9ca0-f918-4d29-a682-2ce7118fb5cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:24.581338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:24.582208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:24.583053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 152/321] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:24.589845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:24.670906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56f6d-63c0-4c60-9c1c-98488b6670a3 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.671279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56f6d-63c0-4c60-9c1c-98488b6670a3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.671444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56f6d-63c0-4c60-9c1c-98488b6670a3 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.673039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 153/322] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:24.677789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00df5-47fc-4c03-9291-bd744be9a3cc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.678071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00df5-47fc-4c03-9291-bd744be9a3cc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.678343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00df5-47fc-4c03-9291-bd744be9a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.690542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53ee70-56e0-4738-9a69-c5b40e8fbaa3 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:24.695353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-63c00df5-47fc-4c03-9291-bd744be9a3cc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:24.696527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-63c00df5-47fc-4c03-9291-bd744be9a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:24.722807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:24.723498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.723774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.724042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.724784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:24.725084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:24.726450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b24499-d88d-4145-9bf1-4efb80410a34 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:24.734156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 170/323] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:24.735440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd055c58-d283-4a1d-9c9a-d917c04cc0ac None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.735726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd055c58-d283-4a1d-9c9a-d917c04cc0ac None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.735996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd055c58-d283-4a1d-9c9a-d917c04cc0ac None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.737202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 171/324] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:24.739503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd055c58-d283-4a1d-9c9a-d917c04cc0ac None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:24.764328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 154/325] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:24.765760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.766042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.766310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.781960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:24.783166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:24.840333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd055c58-d283-4a1d-9c9a-d917c04cc0ac None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:24.846389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 155/326] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:24.859039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:24.875027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:24.875897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.876188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.876449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] PATH_INFO: `/v3/users/31df7c8aaaad4e439ff83e39ef0834ef` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.877653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] RBAC: Authorizing `identity:get_user(user_id=31df7c8aaaad4e439ff83e39ef0834ef)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:24.879125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:24.880825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 172/327] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:24 2022] GET /identity/v3/users/31df7c8aaaad4e439ff83e39ef0834ef => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:24.881575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:24.939139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7c884-1c46-43dc-ad47-c621c3ca304d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:24.970279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:24.971107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:24.971384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:24.971648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:24.976005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ae897-831e-425d-9635-a0828ef21a40 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:24.981161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:24.988962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:24.989830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:24.990636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 156/328] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:24.991333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:25.009263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:25.010061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:25.010337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:25.010606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:25.011821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:25.013281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:25.014912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 173/329] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:25.015742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:25.089991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0931ae-8b69-4884-ab5b-959e764d9902 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:25.111502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64c7cf-842b-4379-b6f9-05f38f7d8937 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:25.122320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:25.122992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:25.123270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:25.123541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:25.124366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] RBAC: Adding query filter params (role.id=0f86d21e44a34c5c9fc395e47e3878ec, user.id=31df7c8aaaad4e439ff83e39ef0834ef, scope.system=all) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:25.124779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:25.126161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:25.137350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 157/330] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 4 08:02:24 2022] GET /identity/v3/role_assignments?user.id=31df7c8aaaad4e439ff83e39ef0834ef&scope.system=all&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 510 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:25.138014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:25.144246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:25.144934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:25.145217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:25.145470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:25.146232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:25.146545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:25.148043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:25.157493 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 174/331] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:25.163444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:25.243928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6eb31-3cf1-4636-8479-f39392da9b81 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:25.275537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14db25-d26d-4862-a8f3-713cd5bcaa97 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:25.277593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:25.278566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:25.278935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:25.279218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] PATH_INFO: `/v3/groups` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:25.279924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:25.281464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:25.310913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 158/332] 10.222.0.59 () {60 vars in 1134 bytes} [Wed May 4 08:02:25 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:25.316919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108fd39-b44c-4732-9f6d-28b45e3333ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:25.317824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108fd39-b44c-4732-9f6d-28b45e3333ec None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:25.318422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108fd39-b44c-4732-9f6d-28b45e3333ec None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:25.318690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108fd39-b44c-4732-9f6d-28b45e3333ec None admin] PATH_INFO: `/v3/users/2f8c24b453894f579969b8c2672d5388` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:25.320099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108fd39-b44c-4732-9f6d-28b45e3333ec None admin] RBAC: Authorizing `identity:get_user(user_id=2f8c24b453894f579969b8c2672d5388)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:25.321636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108fd39-b44c-4732-9f6d-28b45e3333ec None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:25.328457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 175/333] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:25 2022] GET /identity/v3/users/2f8c24b453894f579969b8c2672d5388 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:25.329617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:25.432693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83fc40-f876-4bd2-bc65-88fab6a3f376 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:25.466507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d65b9-5748-4823-8493-68422b48d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:25.467402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d65b9-5748-4823-8493-68422b48d26a None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:25.467675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d65b9-5748-4823-8493-68422b48d26a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:25.467913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d65b9-5748-4823-8493-68422b48d26a None admin] PATH_INFO: `/v3/system/users/2f8c24b453894f579969b8c2672d5388/roles/5ababcfa963a4528801ab31a5847a2f2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:25.469685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d65b9-5748-4823-8493-68422b48d26a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2f8c24b453894f579969b8c2672d5388, role_id=5ababcfa963a4528801ab31a5847a2f2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:25.471104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d65b9-5748-4823-8493-68422b48d26a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:25.480215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 159/334] 10.222.0.59 () {58 vars in 1334 bytes} [Wed May 4 08:02:25 2022] PUT /identity/v3/system/users/2f8c24b453894f579969b8c2672d5388/roles/5ababcfa963a4528801ab31a5847a2f2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:02:27.933873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f425e-a184-45ac-b3ba-876d0d7b8d5e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:27.934805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f425e-a184-45ac-b3ba-876d0d7b8d5e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:27.935282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f425e-a184-45ac-b3ba-876d0d7b8d5e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:27.937216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 176/335] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:27.949174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:27.950114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:27.950585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:27.972752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:27.974312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:28.053136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 160/336] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:28.096319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f425e-a184-45ac-b3ba-876d0d7b8d5e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:28.200482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f425e-a184-45ac-b3ba-876d0d7b8d5e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:28.243917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9016-03ff-4183-96af-745c3a20f281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:28.245138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9016-03ff-4183-96af-745c3a20f281 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.245646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9016-03ff-4183-96af-745c3a20f281 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.246113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9016-03ff-4183-96af-745c3a20f281 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.258012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d9016-03ff-4183-96af-745c3a20f281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-ce7d9016-03ff-4183-96af-745c3a20f281 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:28.266227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:28.267254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:28.268057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:28.270992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 177/337] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:28.276589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:28.392064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78e299-b753-4e1c-bbf9-3f6c073f1008 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:28.407099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2786986-1192-4e8c-bced-0f3f47a8dd57 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.407606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2786986-1192-4e8c-bced-0f3f47a8dd57 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.408100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2786986-1192-4e8c-bced-0f3f47a8dd57 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.409724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 178/338] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:28.420892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c640ec-4de5-47db-a8a1-7de240024406 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.421210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c640ec-4de5-47db-a8a1-7de240024406 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.421777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c640ec-4de5-47db-a8a1-7de240024406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.441749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:28.442705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.443366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.443641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.444456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:28.444766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:28.446163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:28.455345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 161/339] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:28.457891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-87c640ec-4de5-47db-a8a1-7de240024406 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:28.462054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-87c640ec-4de5-47db-a8a1-7de240024406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:28.463941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:28.556481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 179/340] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:28.558255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74356-bd70-428a-8549-96a440fe4302 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.558739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74356-bd70-428a-8549-96a440fe4302 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.559238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df74356-bd70-428a-8549-96a440fe4302 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.560977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 180/341] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:28.566376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.566921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.567394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.582133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff861-8795-4daa-ad17-6031d39a7c82 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:28.594901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:28.596214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:28.622496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:28.623526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.623941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.624400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.677024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 181/342] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:28.677889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:28.743830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:28.745288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:28.842828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b425e-b47c-47ec-845a-d4206b5ec75c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:28.877546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b347c-4251-4826-95fd-9406fe85a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:28.878351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b347c-4251-4826-95fd-9406fe85a8ba None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.878632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b347c-4251-4826-95fd-9406fe85a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.878953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b347c-4251-4826-95fd-9406fe85a8ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.886258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 162/343] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:28.887488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:28.894663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b347c-4251-4826-95fd-9406fe85a8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-ad4b347c-4251-4826-95fd-9406fe85a8ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:28.904887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:28.905917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 08:02:28.906737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:28.908256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 182/344] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:28.909689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffef92-2ec6-44f3-95f0-15e931d74030 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:28.909901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffef92-2ec6-44f3-95f0-15e931d74030 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:28.910176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffef92-2ec6-44f3-95f0-15e931d74030 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:28.911465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 183/345] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:28.912151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffef92-2ec6-44f3-95f0-15e931d74030 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:28.998555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc4bd8-7f55-46f8-b06a-3f5494396212 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.019658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffef92-2ec6-44f3-95f0-15e931d74030 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.033528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4332d64-3361-4747-923d-86db7799e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.034600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4332d64-3361-4747-923d-86db7799e1ac None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.035150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4332d64-3361-4747-923d-86db7799e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.035619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4332d64-3361-4747-923d-86db7799e1ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.046172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4332d64-3361-4747-923d-86db7799e1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d4332d64-3361-4747-923d-86db7799e1ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:29.054527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:29.055496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:29.056404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:29.057032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.057032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.057032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.057032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.058202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.059633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 163/346] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:29.059826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.061214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.061714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.061891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 184/347] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:28 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:29.062410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.062706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.084391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:29.086005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:29.157085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 164/348] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:29.158317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.172983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd0a8-a23e-4644-85d6-1781670c323e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.206823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.207518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.207801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.208071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.208816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:29.209118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.214742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.219885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 185/349] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:29.220742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.270293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d283f-a555-4906-a4e9-55a9efd8914f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.304970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.306014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.306480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.306965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.307896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:29.308407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.309964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.319288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 165/350] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:29.320459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.325507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f3a12-7f75-49d0-a8ef-eefa033b0e49 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.359178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.360046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.360326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.360601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.366890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.368387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.370467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 186/351] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:29.375485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.433324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6d962-15c6-4f64-a232-0c5ae2ab1816 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.478477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80cd63-ede2-42c9-95ac-548495eb27a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.479322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80cd63-ede2-42c9-95ac-548495eb27a6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.479594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80cd63-ede2-42c9-95ac-548495eb27a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.479860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80cd63-ede2-42c9-95ac-548495eb27a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.494838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80cd63-ede2-42c9-95ac-548495eb27a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-3c80cd63-ede2-42c9-95ac-548495eb27a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:29.503773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:29.504757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:29.505614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 166/352] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:29.506852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b773-96bd-48cc-a290-37771e5f4e69 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.506852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b773-96bd-48cc-a290-37771e5f4e69 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.507144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b773-96bd-48cc-a290-37771e5f4e69 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.508401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 167/353] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:29.509131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6b773-96bd-48cc-a290-37771e5f4e69 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.510658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b7c34-ecab-43f5-b8c0-936edc9c0cbb None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.556893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.557813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.558098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.558370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] PATH_INFO: `/v3/users/2f8c24b453894f579969b8c2672d5388` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.560216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] RBAC: Authorizing `identity:get_user(user_id=2f8c24b453894f579969b8c2672d5388)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.561695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.563481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 187/354] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/users/2f8c24b453894f579969b8c2672d5388 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:29.564233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.646999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6b773-96bd-48cc-a290-37771e5f4e69 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.686054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.686704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.687110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.687378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.689179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d652da-a9ff-48f8-9f65-20b4d6fb3388 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:29.733790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:29.734487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.734769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.735112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.735924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=6a34e27a9e9c4905968993041711ccdb) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:29.736230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.737675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0e18c-823a-4d75-93e0-edbda4af3183 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.745633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 188/355] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:29.746144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:29.746426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:29.746700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:29.764599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:29.765883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:29.773653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:29.775988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:29.852183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 189/356] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:29.852183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.917873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 168/357] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:29.919462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:29.993378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0617d6-6e28-43b8-995d-0237c397d77c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.030776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fec26-f8b0-4d4e-8aad-7de0aa14c9ab None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.032538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.033415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.033711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.034081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.035323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:30.035323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.036820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.045644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 190/358] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:30.046743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.069129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.070116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.070552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.071404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.072394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] RBAC: Adding query filter params (role.id=5ababcfa963a4528801ab31a5847a2f2, user.id=2f8c24b453894f579969b8c2672d5388, scope.system=all) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:30.072848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.074466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.086625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 169/359] 10.222.0.59 () {56 vars in 1308 bytes} [Wed May 4 08:02:29 2022] GET /identity/v3/role_assignments?user.id=2f8c24b453894f579969b8c2672d5388&scope.system=all&role.id=5ababcfa963a4528801ab31a5847a2f2 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:30.087872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.156547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741c87c-925a-4bd1-b387-a7aab20f3b05 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.192456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac968c-8a15-462c-8a23-44e9a8717b4b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.193753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.194645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.195016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.195360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.207837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:30.216279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:30.217408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:30.218483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 191/360] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:30.223577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.235614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6266c82-bed6-4714-90c7-7fc2575cdc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.236857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266c82-bed6-4714-90c7-7fc2575cdc98 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.237319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266c82-bed6-4714-90c7-7fc2575cdc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.237771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266c82-bed6-4714-90c7-7fc2575cdc98 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.239331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6266c82-bed6-4714-90c7-7fc2575cdc98 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.240995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6266c82-bed6-4714-90c7-7fc2575cdc98 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.243000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 170/361] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:30.244697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed15a-26ee-4197-bd7f-d865a36ab610 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.245214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed15a-26ee-4197-bd7f-d865a36ab610 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.245689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed15a-26ee-4197-bd7f-d865a36ab610 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.247620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 171/362] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:30.248668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed15a-26ee-4197-bd7f-d865a36ab610 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.333630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddcfba-463e-455f-8f04-38f974b1bf80 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.357725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed15a-26ee-4197-bd7f-d865a36ab610 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.369805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.370455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.370735 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.371097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.396167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.396536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.396715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.396976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.397721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:30.399695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.399695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1b25e-7e6a-41ce-b2a3-43b01f62db10 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.416589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 172/363] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:30.418036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.418278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.418549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.443191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:30.444747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:30.467752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.469777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.537686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 173/364] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:30.538706 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.580346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 192/365] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:30.583429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.675501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048fa22-8ed8-477f-a1dc-393ff52dd552 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.708310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4b93a-6d57-488a-8052-ee010f7f78be None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.713560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.714407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.714676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.714969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.716136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.717607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.719261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 174/366] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:30.720014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.746262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.746938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.747216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.747478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.828408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:30.829985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:30.833565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023d4ac-9c85-47c7-b285-32225072b5cf None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:30.879378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:30.880188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:30.880463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:30.880727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:30.895283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:30.903806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:30.905002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 175/367] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:30.905976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:30.955311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 193/368] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:30.956377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.047153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38678b-3023-4b17-91c5-374c163f0c29 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.061531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a712-2f46-403e-8689-3845b6015207 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.088054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.088925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.089199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.089465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.090644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.092109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.098652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 176/369] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.099563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.099746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.100405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.100688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.100957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.101784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=a54ac5cae8c247e594fd4b678694455e) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:31.102221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.103775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.109581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 194/370] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:30 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.110377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.226501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560fa9f-be5d-437e-86ea-73ffda9b6ec8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.230385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ad9ed-2d5d-4883-a7dd-186ba99f4f97 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.268892 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.270122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.270473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.271326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.271663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:31.272366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.274266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.280345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.284181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.289342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.289531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 177/371] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.289531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.290175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.293441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.295200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.297939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 195/372] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.299093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.425208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a93f67-2180-4940-b27d-de96f475c9f1 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.432789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342177f-977f-4af5-a6af-df39565cc8b1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.461362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.462371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.462838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.463422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.467063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.468541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.468541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.468541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.469681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.471166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.474492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 178/373] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.474615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.539463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.541210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.602715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1ca4-8cbe-420e-bc03-ba239f9b6317 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.641776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.643067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.643558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.644021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.644882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 196/374] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:31.645599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.645701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.647581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.649699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 179/375] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.650643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.757155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9adf-3d4f-4994-8fdf-f9a961de66c0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.767798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551e5c6-11c2-4036-bc8c-b207b9e253fd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.793139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.793883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.794459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.794741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.795870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=6a34e27a9e9c4905968993041711ccdb) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:31.796443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.798346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.802209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.803105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.803418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.803698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] PATH_INFO: `/v3/projects/464080567f3f4194af284b80faf51856` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.804750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 197/376] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=85adb51ebde647209c75f54b8c949bdc => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.804951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] RBAC: Authorizing `identity:get_project(project_id=464080567f3f4194af284b80faf51856)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.805547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.806466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.813033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 180/377] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/projects/464080567f3f4194af284b80faf51856 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.814407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:31.914761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb8550-23c7-470f-8c7e-af14b0895976 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.931553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e520d-ccc3-4a29-9d99-7b3b67d2f340 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:31.950812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.951509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.951785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.952057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:31.952935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=a54ac5cae8c247e594fd4b678694455e) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:31.953241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:31.954706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:31.961492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 198/378] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=85adb51ebde647209c75f54b8c949bdc => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:31.994643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8c8f8-6784-4bd7-9cdc-29ba0f4b7832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:31.995568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c8f8-6784-4bd7-9cdc-29ba0f4b7832 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:31.995844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c8f8-6784-4bd7-9cdc-29ba0f4b7832 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:31.996112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8c8f8-6784-4bd7-9cdc-29ba0f4b7832 None admin] PATH_INFO: `/v3/groups/6716a121d2a34bb489ea27e13321f743` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:32.012900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8c8f8-6784-4bd7-9cdc-29ba0f4b7832 None admin] RBAC: Authorizing `identity:get_group(group_id=6716a121d2a34bb489ea27e13321f743)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:32.013215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8c8f8-6784-4bd7-9cdc-29ba0f4b7832 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:32.015200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 181/379] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:31 2022] GET /identity/v3/groups/6716a121d2a34bb489ea27e13321f743 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:32.022983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:32.165375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d5c54-3ec5-48f8-b894-4648c7a0859c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:32.207487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:32.208567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:32.209037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:32.209536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:32.210595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] RBAC: Adding query filter params (group.id=6716a121d2a34bb489ea27e13321f743, role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=464080567f3f4194af284b80faf51856) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:32.211151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:32.212847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926e9f-93a1-488f-8c25-ddc4206020aa None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:32.219771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 199/380] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:32 2022] GET /identity/v3/role_assignments?group.id=6716a121d2a34bb489ea27e13321f743&scope.project.id=464080567f3f4194af284b80faf51856&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:32.411979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6752d-5be4-40b0-b6da-24510625a521 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:32.412485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6752d-5be4-40b0-b6da-24510625a521 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:32.412562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6752d-5be4-40b0-b6da-24510625a521 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:32.414092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 182/381] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:32.420690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:32.420977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:32.421167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:32.441229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:32.442424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:32.524884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 200/382] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:32.551777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6752d-5be4-40b0-b6da-24510625a521 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:32.665531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6752d-5be4-40b0-b6da-24510625a521 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:32.707284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:32.708438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:32.708925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:32.709393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:32.725164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:32.733251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:32.734181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:32.735024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:32.742371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 183/383] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:32.743611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:32.878407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ebd9d-7585-484b-b027-5dbc09856dd5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:32.914076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:32.914745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:32.915048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:32.915312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:32.916055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:32.916350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:32.917713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:32.927126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 201/384] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:32.933022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:33.069575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d2d21-f63f-4e45-8389-ffe7a16cd421 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:33.108733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:33.109994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:33.110497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:33.110983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:33.112333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:33.113944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:33.116070 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 184/385] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:32 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:33.121817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:33.256200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb41f1-f185-4bb3-973a-7cccc5135212 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:33.293747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff42cf-9c53-445c-9c5f-c621d133df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:33.294617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff42cf-9c53-445c-9c5f-c621d133df94 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:33.294904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff42cf-9c53-445c-9c5f-c621d133df94 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:33.295181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff42cf-9c53-445c-9c5f-c621d133df94 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:33.296476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff42cf-9c53-445c-9c5f-c621d133df94 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:33.297911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff42cf-9c53-445c-9c5f-c621d133df94 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:33.299978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 202/386] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:33 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:33.305618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:33.457504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b2d7-8a7c-4e25-b82d-78d66181c76a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:33.500151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb458a6a-12a5-4b22-8578-fb8a2d6a7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:33.501038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458a6a-12a5-4b22-8578-fb8a2d6a7141 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:33.501314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458a6a-12a5-4b22-8578-fb8a2d6a7141 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:33.501588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb458a6a-12a5-4b22-8578-fb8a2d6a7141 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb/groups/bfe61cb002b64dada667579ad3798431/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:33.503537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb458a6a-12a5-4b22-8578-fb8a2d6a7141 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a34e27a9e9c4905968993041711ccdb, group_id=bfe61cb002b64dada667579ad3798431, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:33.504976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb458a6a-12a5-4b22-8578-fb8a2d6a7141 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:33.523839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 185/387] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 4 08:02:33 2022] PUT /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb/groups/bfe61cb002b64dada667579ad3798431/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:33.988001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a494404-1a86-4bc4-bab6-b0d5b085a69e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:33.989893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a494404-1a86-4bc4-bab6-b0d5b085a69e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:33.989893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a494404-1a86-4bc4-bab6-b0d5b085a69e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:33.989893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 203/388] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:33.995195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:33.995694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:33.996256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.019878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:34.021388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:34.103891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 186/389] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:34.137950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a494404-1a86-4bc4-bab6-b0d5b085a69e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:34.244544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a494404-1a86-4bc4-bab6-b0d5b085a69e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:34.286254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:34.287841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:34.288308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:34.288760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.299731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:34.310464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:34.311409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:34.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:34.315057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 204/390] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:34.321063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:34.490295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9fc6d-28e8-4b41-8856-46454cf9bda4 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:34.536993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:34.537580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:34.537857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:34.538123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.538866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:34.539191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:34.540562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:34.553175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 187/391] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:34.558493 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:34.675340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9848301-2ee4-4e69-a428-2bc841556094 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:34.714315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8297984-48c5-4e60-bf68-5162111ebaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:34.715250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297984-48c5-4e60-bf68-5162111ebaab None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:34.715524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297984-48c5-4e60-bf68-5162111ebaab None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:34.715850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8297984-48c5-4e60-bf68-5162111ebaab None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.717004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8297984-48c5-4e60-bf68-5162111ebaab None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:34.718578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8297984-48c5-4e60-bf68-5162111ebaab None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:34.720260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 205/392] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:34 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:34.726042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:34.874999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47914cd-6588-4fef-b957-334265b001d5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:34.890725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5ae1-79c6-4b1e-9dfe-6289030f0d4d None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:34.891434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5ae1-79c6-4b1e-9dfe-6289030f0d4d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:34.891900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f5ae1-79c6-4b1e-9dfe-6289030f0d4d None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.893944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 206/393] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:34.912074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:34.912356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:34.912629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.922160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:34.923354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:34.923828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:34.924267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:34.925638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:34.927280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:34.929495 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 188/394] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:34 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:34.936244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:34.940782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:34.942177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:35.048680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 207/395] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:35.081585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dcf1d-c890-42e5-9f1d-366581c9f9a0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.085693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.122910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776050b-889b-498c-8c75-30267be5192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.122910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776050b-889b-498c-8c75-30267be5192d None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.122910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776050b-889b-498c-8c75-30267be5192d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.122910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776050b-889b-498c-8c75-30267be5192d None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e/groups/bfe61cb002b64dada667579ad3798431/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.123374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776050b-889b-498c-8c75-30267be5192d None admin] RBAC: Authorizing `identity:create_grant(project_id=a54ac5cae8c247e594fd4b678694455e, group_id=bfe61cb002b64dada667579ad3798431, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:35.123374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776050b-889b-498c-8c75-30267be5192d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:35.134339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 189/396] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 4 08:02:34 2022] PUT /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e/groups/bfe61cb002b64dada667579ad3798431/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:35.135652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b403-5439-43a6-adb1-95a1d9fc8cd0 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.136002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b403-5439-43a6-adb1-95a1d9fc8cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.136344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b403-5439-43a6-adb1-95a1d9fc8cd0 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.137936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 190/397] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:35.148867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2db36-c35f-4799-8f11-1220546ec093 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.149214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2db36-c35f-4799-8f11-1220546ec093 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.149489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2db36-c35f-4799-8f11-1220546ec093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.189068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c8e2db36-c35f-4799-8f11-1220546ec093 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:35.191997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c8e2db36-c35f-4799-8f11-1220546ec093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:35.283396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab73f-c0e3-4df2-af51-0057ef106c19 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.297465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 191/398] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:35.299208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b95d1-da56-40d6-8a96-f0b20461a755 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.299709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b95d1-da56-40d6-8a96-f0b20461a755 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.300175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b95d1-da56-40d6-8a96-f0b20461a755 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.306047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 192/399] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:35.308215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.308713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.309193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.332378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:35.335159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:35.345907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.346721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.347203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.347308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.364145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:35.372184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:35.373297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:35.374109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 208/400] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:35.374820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.432967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 193/401] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:35.434139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.510082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e7ee9-8161-43ee-8935-31814357fcbd None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.533786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5d64-9d4b-4d23-baf3-87162871c5b9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.543177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.544038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.544311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.544570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.555038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:35.563183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:35.564087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 209/402] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:35.565512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.574248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.575219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.575689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.576163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.577127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:35.577654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:35.579250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:35.587868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 194/403] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:35.593400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.662372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3c63-35a9-4a67-b42c-3cc062a02f71 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.691684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811e971-b99c-4a6b-be21-1d53caa6cf6b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.695496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.696054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.696329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.696598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.706983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:35.714690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:35.715603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 210/404] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:35.716888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.730649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.731702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.732186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.732644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.733574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:35.734106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:35.735723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:35.744421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 195/405] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:35.745561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.815290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a8ed-9a5b-4a18-bb28-946dbf1f3b9f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.843549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26967cf-05d5-44fc-904d-9ef60a6cef2b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.849232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.850090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.850360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.850622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.851816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:35.853249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:35.859172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 211/406] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:35.859172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.883853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.884899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.885397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.885856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.886789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:35.887307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:35.888852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:35.897845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 196/407] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:35.899046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:35.953476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343bb0a-2f36-49f4-8dce-3eeb7df76544 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:35.987855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:35.988803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:35.989080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:35.989366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:35.990898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:35.992188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:35.994195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 212/408] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:35.995168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.001833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca2ba6-2a83-4017-bca5-dcd358677c89 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.036629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.037852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.038346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.038803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.040215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.041831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.043747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 197/409] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:36.045756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.095641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fad734-cab7-446e-b591-f901ae540235 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.128373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.129225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.129496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.129767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] PATH_INFO: `/v3/groups/6716a121d2a34bb489ea27e13321f743` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.130958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] RBAC: Authorizing `identity:get_group(group_id=6716a121d2a34bb489ea27e13321f743)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.132453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.134464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 213/410] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:35 2022] GET /identity/v3/groups/6716a121d2a34bb489ea27e13321f743 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:36.135298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.149505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184404-e631-494f-9a7e-d70e0495a423 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.182750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.183901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.184341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.184618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.185797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.187303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.189307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 198/411] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:36 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:36.190127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.238996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15194871-3e67-4bf8-a59f-caf89d117958 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.274062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69806237-05f0-4edd-b6ee-a79112da803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.274979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69806237-05f0-4edd-b6ee-a79112da803b None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.275271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69806237-05f0-4edd-b6ee-a79112da803b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.275548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69806237-05f0-4edd-b6ee-a79112da803b None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e/groups/bfe61cb002b64dada667579ad3798431/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.277845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69806237-05f0-4edd-b6ee-a79112da803b None admin] RBAC: Authorizing `identity:create_grant(project_id=a54ac5cae8c247e594fd4b678694455e, group_id=bfe61cb002b64dada667579ad3798431, role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.279330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69806237-05f0-4edd-b6ee-a79112da803b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.292839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99799e-ae11-4215-a4ea-d4e569e2916c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.294247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 214/412] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 4 08:02:36 2022] PUT /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e/groups/bfe61cb002b64dada667579ad3798431/roles/85adb51ebde647209c75f54b8c949bdc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:36.295592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d0f96-32ea-4710-87ae-af55101117ae None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.295877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d0f96-32ea-4710-87ae-af55101117ae None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.296175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d0f96-32ea-4710-87ae-af55101117ae None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.301874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 215/413] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:36.301874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d0f96-32ea-4710-87ae-af55101117ae None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.341282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09e86-a24d-4d55-ab8f-f383d4a5c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.342601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09e86-a24d-4d55-ab8f-f383d4a5c573 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.343207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09e86-a24d-4d55-ab8f-f383d4a5c573 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.343717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09e86-a24d-4d55-ab8f-f383d4a5c573 None admin] PATH_INFO: `/v3/projects/464080567f3f4194af284b80faf51856` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.345209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09e86-a24d-4d55-ab8f-f383d4a5c573 None admin] RBAC: Authorizing `identity:get_project(project_id=464080567f3f4194af284b80faf51856)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.347289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09e86-a24d-4d55-ab8f-f383d4a5c573 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.354361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 199/414] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:36 2022] GET /identity/v3/projects/464080567f3f4194af284b80faf51856 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:36.354361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.354361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.354361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.379463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:36.380697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:36.443564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d0f96-32ea-4710-87ae-af55101117ae None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.467240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 200/415] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:36.471823 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.496921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.497281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.497557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.497821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb/groups/bfe61cb002b64dada667579ad3798431/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.500179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] RBAC: Authorizing `identity:create_grant(project_id=6a34e27a9e9c4905968993041711ccdb, group_id=bfe61cb002b64dada667579ad3798431, role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.501625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.518676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 216/416] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 4 08:02:36 2022] PUT /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb/groups/bfe61cb002b64dada667579ad3798431/roles/85adb51ebde647209c75f54b8c949bdc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:36.519821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.589651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c23a2-aead-4026-809b-0f8b59829db3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.634910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.637366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.637641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.638738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] PATH_INFO: `/v3/projects/464080567f3f4194af284b80faf51856/groups/6716a121d2a34bb489ea27e13321f743/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.642019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] RBAC: Authorizing `identity:create_grant(project_id=464080567f3f4194af284b80faf51856, group_id=6716a121d2a34bb489ea27e13321f743, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.644369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.662479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 201/417] 10.222.0.59 () {58 vars in 1442 bytes} [Wed May 4 08:02:36 2022] PUT /identity/v3/projects/464080567f3f4194af284b80faf51856/groups/6716a121d2a34bb489ea27e13321f743/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:36.703434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d83a5-79ab-4cb8-9830-1d396d88c5fe None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.764679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.765490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.765867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.766220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.787418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:36.795421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:36.796522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:36.797336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:36.801296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 217/418] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:36.802631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:36.919215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05376b2f-c4ba-46e0-bb76-2701bba9d70c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:36.956100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:36.956766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:36.957040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:36.957302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:36.958036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] RBAC: Adding query filter params (name=member) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:36.958330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:36.959803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:36.968294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 202/419] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:36.973953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:37.114969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cff59-8302-489d-a24b-0c25bea7ded4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:37.153472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:37.154125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.154404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.154675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.222940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:37.224432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:37.323709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 218/420] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:37.329651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:37.455657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f57429-2ffe-4946-973f-cb93673b5423 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:37.501678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4547be-0417-4f46-92b2-e6febb483b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:37.502548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4547be-0417-4f46-92b2-e6febb483b3b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.502825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4547be-0417-4f46-92b2-e6febb483b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.503120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4547be-0417-4f46-92b2-e6febb483b3b None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.504305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4547be-0417-4f46-92b2-e6febb483b3b None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:37.505749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4547be-0417-4f46-92b2-e6febb483b3b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:37.507484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 203/421] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:37 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:37.513102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:37.564721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff8794-7980-47ee-9463-be7557870fad None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.565067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff8794-7980-47ee-9463-be7557870fad None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.565273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff8794-7980-47ee-9463-be7557870fad None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.566778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 204/422] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:37.572111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.572390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.572660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.601346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:37.602535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:37.661887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611d10e-3d1e-4c8a-8337-1e1f53406a44 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:37.702625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 205/423] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:37.728893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:37.731569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:37.732439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.732712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.732981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.734239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:37.735706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:37.737635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 219/424] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:37 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:37.748632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:37.893011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2981c-6ae5-4294-a5da-cc94a231fc33 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:37.893528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfef0d2-3ad0-432f-a967-7342bd3546bd None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:37.929902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:37.930630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.930929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.931205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.932042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=6a34e27a9e9c4905968993041711ccdb) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:37.932349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:37.933790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:37.949533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 220/425] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:37 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:37.973337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:37.974175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:37.974453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:37.974723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:37.997012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:38.005007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:38.006064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:38.007038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 206/426] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:38.014037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:38.138162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f552d5c-b949-40cf-a238-7708433d52ea None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:38.174862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:38.175552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:38.175835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:38.176102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:38.176854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:38.177158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:38.178535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:38.187742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 221/427] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:38.193593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:38.321775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d52c1-cd92-484b-ba41-fdde6f87acc0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:38.360130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:38.360778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:38.361055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:38.361330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:38.436727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:38.438235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:38.534939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 207/428] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:38.540911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:38.654095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731670a6-c37a-4776-8bfd-c04888b50c5a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:38.687604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:38.688592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:38.688818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:38.689134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:38.690333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:38.691811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:38.694147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 222/429] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:38 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:38.699701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:38.815395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c37c34-97a9-4016-bdf8-8d8751054053 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:38.855496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abbdb-734f-4ef9-965a-fb660bfa5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:38.856366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abbdb-734f-4ef9-965a-fb660bfa5a6c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:38.856700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abbdb-734f-4ef9-965a-fb660bfa5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:38.856971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abbdb-734f-4ef9-965a-fb660bfa5a6c None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:38.858179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627abbdb-734f-4ef9-965a-fb660bfa5a6c None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:38.859672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627abbdb-734f-4ef9-965a-fb660bfa5a6c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:38.861598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 208/430] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:38 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:38.867462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:38.921453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115aa66-eedb-4855-86dd-c666dfa74431 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:38.921758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115aa66-eedb-4855-86dd-c666dfa74431 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:38.922002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115aa66-eedb-4855-86dd-c666dfa74431 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:38.924041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 209/431] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:38.932060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54061f2-ce7d-479a-aba9-de9ff2675495 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:38.932346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54061f2-ce7d-479a-aba9-de9ff2675495 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:38.932791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54061f2-ce7d-479a-aba9-de9ff2675495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:38.953065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f54061f2-ce7d-479a-aba9-de9ff2675495 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:38.954194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f54061f2-ce7d-479a-aba9-de9ff2675495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:38.981851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b8acb-5d90-4c1e-a305-f71ecacb9965 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.026646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.028201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.028691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.029321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.030475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=0f86d21e44a34c5c9fc395e47e3878ec, scope.project.id=a54ac5cae8c247e594fd4b678694455e) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:39.031143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:39.033467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:39.042042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 223/432] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:38 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=0f86d21e44a34c5c9fc395e47e3878ec => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:39.043011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 210/433] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:39.072331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.177524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642510-3946-4628-b8f6-2f24c69cdf41 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.212724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.213469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.213751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.214076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.225525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:39.233977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:39.234973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:39.235783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 224/434] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:39.238664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe791c-1fff-4598-82bd-32d6c25aa5f4 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.239267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe791c-1fff-4598-82bd-32d6c25aa5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.239734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe791c-1fff-4598-82bd-32d6c25aa5f4 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.241200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.245790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 211/435] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:39.247735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.248238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.248704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.271022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:39.272853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:39.354375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 212/436] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:39.356104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96cae6-0b29-4020-b375-23dfbd48319c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.377655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.393840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.394527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.394804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.395108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.395869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:39.396172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:39.397592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:39.406501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 225/437] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:39.412137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.484671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e17bb-37a1-4f6e-aab5-c8b91c7d3027 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.509315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfcc1c3-f28a-4e5a-9256-cacdd96a0ce3 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.518652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.519487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.519763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.520029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.530028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:39.538130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:39.539234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:39.540386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 213/438] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:39.544891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.547883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3c359-3cd0-4f8c-ab9f-87c4755a2f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.549816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3c359-3cd0-4f8c-ab9f-87c4755a2f85 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.550241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3c359-3cd0-4f8c-ab9f-87c4755a2f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.550650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3c359-3cd0-4f8c-ab9f-87c4755a2f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.618408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3c359-3cd0-4f8c-ab9f-87c4755a2f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:39.619906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3c359-3cd0-4f8c-ab9f-87c4755a2f85 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:39.637967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6977-940d-424d-a860-908d1a99ac13 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.678021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.678678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.678981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.679251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.680021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:39.680323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:39.681687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67ee74-a2e5-43fb-a177-c2d8669cdbd6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:39.689315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 214/439] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:39.692549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f388fe-0ad8-481b-b593-73ba9163e8dd None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.692549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f388fe-0ad8-481b-b593-73ba9163e8dd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.692549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f388fe-0ad8-481b-b593-73ba9163e8dd None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.692549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 215/440] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:39.695181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f388fe-0ad8-481b-b593-73ba9163e8dd None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.718283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 226/441] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:02:39.719710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.719996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.720264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.735692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:39.736752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:39.792280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f388fe-0ad8-481b-b593-73ba9163e8dd None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.798985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 227/442] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:39.799838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:39.825060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.825701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.825971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.826236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.897747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:39.899230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:39.914388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204b74-d3c9-420b-843d-7bb1c019e920 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:39.953742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:39.954604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:39.954903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:39.955179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] PATH_INFO: `/v3/projects/a54ac5cae8c247e594fd4b678694455e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:39.956386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] RBAC: Authorizing `identity:get_project(project_id=a54ac5cae8c247e594fd4b678694455e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:39.957822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:39.959549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 228/443] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/projects/a54ac5cae8c247e594fd4b678694455e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:39.960295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.006760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 216/444] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:02:40.007811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.056993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c024c7c-2449-4276-b931-cfbbe4206886 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.090423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.091227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.091507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.091777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.101876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:40.104420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e727a-6cc4-47cc-942c-c0000daf22fd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:40.111281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:40.112290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:40.113122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 229/445] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:40.113805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.138694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.139575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.139894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.140167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.141368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.142796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.144416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 217/446] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:40.145166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.218289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c87e7-ccc6-4593-9c97-9c24c587b383 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.238199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb353f-3fc0-4ba7-8ede-3fe0ff84dfc1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.249569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.250421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.250698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.250996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] PATH_INFO: `/v3/projects/6a34e27a9e9c4905968993041711ccdb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.252177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] RBAC: Authorizing `identity:get_project(project_id=6a34e27a9e9c4905968993041711ccdb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.253607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.255335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 230/447] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/projects/6a34e27a9e9c4905968993041711ccdb => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:40.256074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.276121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.276719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.276996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.277265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.278014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:40.278319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.279737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.288109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 218/448] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:40.288900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.354729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cebaa-f87c-4278-9a9a-2bc996892e08 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.385358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe6a2-f89a-4f16-a05d-becb4bebac74 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.387923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.388563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.388839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.389110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.389946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=a54ac5cae8c247e594fd4b678694455e) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:40.390251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.391943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.403376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 231/449] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=a54ac5cae8c247e594fd4b678694455e&role.id=85adb51ebde647209c75f54b8c949bdc => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:40.403376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.426084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.426998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.427279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.427552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] PATH_INFO: `/v3/groups/bfe61cb002b64dada667579ad3798431` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.428820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] RBAC: Authorizing `identity:get_group(group_id=bfe61cb002b64dada667579ad3798431)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.430306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.432222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 219/450] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/groups/bfe61cb002b64dada667579ad3798431 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:40.438164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.517622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526590-b393-44cd-bd85-0ca889b8e427 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.542834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4d9c-6cb1-4197-a3f7-40db98e0d832 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.552114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.552839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.553361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.553361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.577806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.578460 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.578738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.579041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.579899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] RBAC: Adding query filter params (group.id=bfe61cb002b64dada667579ad3798431, role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=6a34e27a9e9c4905968993041711ccdb) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:40.580178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.581623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.587854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 220/451] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/role_assignments?group.id=bfe61cb002b64dada667579ad3798431&scope.project.id=6a34e27a9e9c4905968993041711ccdb&role.id=85adb51ebde647209c75f54b8c949bdc => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:40.625479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.627000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.730664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 232/452] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:40.736786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.837319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f21-29e5-4ab5-a4dc-5f257f43704b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:40.870764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:40.871653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:40.871930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:40.872192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] PATH_INFO: `/v3/projects/464080567f3f4194af284b80faf51856` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:40.873383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] RBAC: Authorizing `identity:get_project(project_id=464080567f3f4194af284b80faf51856)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:40.874960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:40.876586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 221/453] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/projects/464080567f3f4194af284b80faf51856 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:40.882234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:40.979753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51b674-715d-43dd-aefa-7ea04c49fff0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:41.012733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff2aa-d897-4c4f-8d39-bd32221214e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:41.013584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff2aa-d897-4c4f-8d39-bd32221214e8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:41.013889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff2aa-d897-4c4f-8d39-bd32221214e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:41.014160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff2aa-d897-4c4f-8d39-bd32221214e8 None admin] PATH_INFO: `/v3/groups/6716a121d2a34bb489ea27e13321f743` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:41.015381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff2aa-d897-4c4f-8d39-bd32221214e8 None admin] RBAC: Authorizing `identity:get_group(group_id=6716a121d2a34bb489ea27e13321f743)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:41.016832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff2aa-d897-4c4f-8d39-bd32221214e8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:41.018459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 233/454] 10.222.0.59 () {56 vars in 1180 bytes} [Wed May 4 08:02:40 2022] GET /identity/v3/groups/6716a121d2a34bb489ea27e13321f743 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:41.024382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:41.121976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007b169-c4f6-445d-9c6e-d5d853331e8c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:41.153672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:41.154325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:41.154601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:41.154870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:41.155805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] RBAC: Adding query filter params (group.id=6716a121d2a34bb489ea27e13321f743, role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=464080567f3f4194af284b80faf51856) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:41.156118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:41.157538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a413e0-4f5d-40ed-9a24-50dc92fdefd5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:41.163325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 222/455] 10.222.0.59 () {56 vars in 1376 bytes} [Wed May 4 08:02:41 2022] GET /identity/v3/role_assignments?group.id=6716a121d2a34bb489ea27e13321f743&scope.project.id=464080567f3f4194af284b80faf51856&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:43.956141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34b60c-2e49-43a8-be74-06b4e4021788 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:43.957181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34b60c-2e49-43a8-be74-06b4e4021788 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:43.957686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34b60c-2e49-43a8-be74-06b4e4021788 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:43.959643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 234/456] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:43.965874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:43.966829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:43.967364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:43.992045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:43.993622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:44.082365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42135d43-eba3-435f-beb1-50c9b8913539 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.082692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42135d43-eba3-435f-beb1-50c9b8913539 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.083070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42135d43-eba3-435f-beb1-50c9b8913539 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.084788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 235/458] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:02:44.084995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 223/458] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:44.089848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.090127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.090398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.110433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.122070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:44.123685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:44.249386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 236/459] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:44.277316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.284851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0afd-65ef-4de8-8b3e-3b044d5b90db None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.338249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.339083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.339359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.339625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.349918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.351165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-5896f714-4f09-46dd-9b9e-e17240b5ba8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:44.368891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:44.369882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:44.370853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:44.370853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:44.370853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:44.370853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:44.370853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 224/460] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:44.375663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45638-f957-4fa0-8d55-05dc32396ba6 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.375663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45638-f957-4fa0-8d55-05dc32396ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.375663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f45638-f957-4fa0-8d55-05dc32396ba6 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.377645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 225/461] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:44.379494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.379771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.380036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.396533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2fcb2-1100-4a59-bbd0-71c4d609595f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.408639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:44.409984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:44.431007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.431958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.432348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.432710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.448084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.449557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:44.475284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:44.476263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:44.477140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:44.477140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:44.477140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:44.477140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:44.480112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 237/462] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:44.481189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.496178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 226/463] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:44.504080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.596978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0203e3-e6ea-47e4-ab77-2988662e18c5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.629874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.630871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.630998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b677f3d-1b0e-41f8-8040-a1031bf5e72d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.631520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.631971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.632943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:44.633426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.635027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:44.654139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 238/464] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:44.659155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.668640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.669461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.669583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.669831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.670735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:44.670874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.672279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0752d21-cac8-4a9b-a115-35d5918bdaa4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:44.688050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 227/465] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:44.688050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa434d3-595e-4f40-bfe8-c9bbd5259c1b None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.688050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa434d3-595e-4f40-bfe8-c9bbd5259c1b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.688050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa434d3-595e-4f40-bfe8-c9bbd5259c1b None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.688050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 228/466] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:44.688050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa434d3-595e-4f40-bfe8-c9bbd5259c1b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.762545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f43b1-9339-4a18-9355-85e93ef7a1b5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.794952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa434d3-595e-4f40-bfe8-c9bbd5259c1b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.796712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.797514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.797796 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.798067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.808609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.810066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:44.827983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:44.828864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:44.829756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:44.829756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:44.829756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:44.829756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:44.829756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 239/467] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:44.830029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.835484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd81334-2d61-4e2f-b76e-896a87134c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.836161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd81334-2d61-4e2f-b76e-896a87134c1f None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.836438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd81334-2d61-4e2f-b76e-896a87134c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.836705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd81334-2d61-4e2f-b76e-896a87134c1f None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.837400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd81334-2d61-4e2f-b76e-896a87134c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.838829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd81334-2d61-4e2f-b76e-896a87134c1f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:44.866926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 229/468] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:44 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:44.866926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.866926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.866926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.886372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:44.887870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:44.954856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c479e-88da-49a8-b675-f2a75a2a28ee None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:44.979530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 230/469] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:44.980549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:44.992586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:44.993268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:44.993550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:44.993824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:44.994563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:44.996121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.019516 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 240/470] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:44 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:45.026821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:45.144332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b889d-1f66-4a7c-8058-ab9bedb316b3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.171487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f60bd-faba-4dfa-87dc-3ec2aab61320 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.183266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.183887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.184161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.184429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.185166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:45.185483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:45.186935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c6ba6-1500-47a5-b5c8-4a8eca028248 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.202339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 231/471] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:45.203899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc865f-85aa-431a-969d-bcc1ada777d9 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.204185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc865f-85aa-431a-969d-bcc1ada777d9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.204454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc865f-85aa-431a-969d-bcc1ada777d9 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.206983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 232/472] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:45.208819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.209654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.209843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc865f-85aa-431a-969d-bcc1ada777d9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:45.210119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.210378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.222292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:45.223854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-065d11de-7955-4fe7-93dc-2f4d9eca17a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:45.241707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:45.244201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 241/473] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.246269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.264759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:45.265994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:45.330385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc865f-85aa-431a-969d-bcc1ada777d9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.349132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 242/474] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:45.354905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:45.383696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.385214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.385981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.386456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.387424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:45.389101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.419450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 233/475] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:45 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:02:45.420623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:45.470737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ada90-154d-41d8-b0cb-74731e6bb6a9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.509075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.511632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.512634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.512634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.513227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:45.513624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:45.515189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.534085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 243/476] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:45.543514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:45.562827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040b6b5-28b0-4f3d-96d7-3342172ca8a1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.632101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.632793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.633068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.633336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.634186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:45.635632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.646475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.sql.core [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 08:02:45.646475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 08:02:45.646475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [parameters: {'id': 'eb08d749c22c449b886a091c3a1c0c6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 08:02:45.646475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80097) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application result = self._query(query) May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application conn.query(q) May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application result.read() May 04 08:02:45.679248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return ref.to_dict() May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 08:02:45.680198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application next(self.gen) May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application yield resource May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application next(self.gen) May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self.session.rollback() May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self.force_reraise() May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise self.value May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application session.commit() May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 08:02:45.681147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._prepare_impl() May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self.session.flush() May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._flush(objects) May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application compat.raise_( May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application flush_context.execute() May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rec.execute(self) May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 08:02:45.682018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 08:02:45.683703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application result = self._query(query) May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application conn.query(q) May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application result.read() May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 08:02:45.685691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [parameters: {'id': 'eb08d749c22c449b886a091c3a1c0c6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:45.686752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 08:02:45.687752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:45.688797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 234/477] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 4 08:02:45 2022] POST /identity/v3/roles => generated 144 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:45.688797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:45.722385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55ec11-bd04-4915-9c0c-2dc7f15538ee None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.758833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.759526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.760158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.760158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.760747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:45.762202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:45.788616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 244/478] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:45 2022] POST /identity/v3/users => generated 249 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:02:45.816994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5292b86-88c9-469f-98c4-67d3ac149fcc None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:45.855422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4aab-cc31-40ea-9121-5e6b24320a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:45.856515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4aab-cc31-40ea-9121-5e6b24320a92 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:45.856940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4aab-cc31-40ea-9121-5e6b24320a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:45.857352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4aab-cc31-40ea-9121-5e6b24320a92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:45.870103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4aab-cc31-40ea-9121-5e6b24320a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-356c4aab-cc31-40ea-9121-5e6b24320a92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:45.879158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:45.880512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 08:02:45.881549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:45.884036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 235/479] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:02:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:45.890244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:46.006850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca44748-85b0-4681-8d43-c699a6d09ae7 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:46.042338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:46.043046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:46.043323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:46.043590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:46.044342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:46.044650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:46.046110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68986cf1-599f-4cae-a417-2e59f61445ae None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:46.055608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 245/480] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:47.722517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0a16-e280-49b3-9183-0f59b8613bba None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:47.723054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0a16-e280-49b3-9183-0f59b8613bba None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:47.723054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0a16-e280-49b3-9183-0f59b8613bba None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:47.724634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 236/481] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:47.730196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:47.730592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:47.730775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:47.751916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:47.753105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:47.786163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807210ab-eab0-4339-9a0b-b532301db18f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:47.786493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807210ab-eab0-4339-9a0b-b532301db18f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:47.786726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807210ab-eab0-4339-9a0b-b532301db18f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:47.788367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 237/482] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:47.793634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:47.794205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:47.794674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:47.818906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:47.820499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:47.837487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 246/483] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:47.883413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:47.913121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 238/484] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:47.944982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:47.982739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595b706-84de-4916-8dd4-4ce38521a87f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.019728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.020533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.020808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.021075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.040701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:48.053786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:48.054722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:48.055589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 247/485] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:48.062663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.165205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930f2f-efba-4b2c-8685-2b7343014ee2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.213313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b959-9a51-4fa1-ad2d-19da5777633f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.232461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.233707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.234207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.234709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.254964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.255637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.255909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.256175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.256917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:48.257218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:48.258594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:48.259427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:48.274556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:48.275579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:48.276450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 239/486] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:48.279298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 248/487] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:48.281825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.285722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.429026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bcd9f-c01f-49a3-b4fa-5e0452524be4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.431114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d479085-7eb6-4859-96ff-0d586d22dc05 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.462457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.463281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.463555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.463821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.466551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.467574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.468083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.468562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.469617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:48.470116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:48.472731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f071ce-ea76-48a3-a248-4ec608ef7d55 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:48.477044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:48.478503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:48.483516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 240/488] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:48.485081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa350ba-e5d3-4c4e-a7a9-aac9436ce000 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.485594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa350ba-e5d3-4c4e-a7a9-aac9436ce000 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.486076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa350ba-e5d3-4c4e-a7a9-aac9436ce000 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.490979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 241/489] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:48.493364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.493852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.494322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:48.500991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:48.501886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:48.502760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:48.502760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:48.502760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:48.502760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:48.506691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 249/490] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:48.508143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.514110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:48.515339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:48.607006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 242/491] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:48.607881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.632810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d166c8-5455-46b8-b2e1-df36c1d8bf21 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.666363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.667565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.668036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.668494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.680456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:48.682287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:48.700188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:48.701071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:48.702051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:48.702051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:48.702051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:48.702051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:48.704412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 250/492] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:48.705473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.728605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b37d-58f2-4f61-92c0-4e32cd74091b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.764021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.764620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.764909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.765176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.765930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:48.766238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:48.767705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:48.778575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 243/493] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:48.779396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.804941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522cdac-6dca-47ec-9018-20437a0c09cf None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.838461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d01943-fc96-441d-aaf7-87fa33ba5e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.839282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01943-fc96-441d-aaf7-87fa33ba5e99 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.839563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01943-fc96-441d-aaf7-87fa33ba5e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.839831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d01943-fc96-441d-aaf7-87fa33ba5e99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.849616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d01943-fc96-441d-aaf7-87fa33ba5e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a8d01943-fc96-441d-aaf7-87fa33ba5e99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:48.857284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:48.858508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:48.859627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 251/494] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:48.860478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aac111-fc26-4a79-a9e4-41318c10555e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.860478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aac111-fc26-4a79-a9e4-41318c10555e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.860478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aac111-fc26-4a79-a9e4-41318c10555e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.866770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 252/495] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:48.866770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87b51-97cd-4cc4-98c7-8865f82502a7 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.866770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87b51-97cd-4cc4-98c7-8865f82502a7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.866770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87b51-97cd-4cc4-98c7-8865f82502a7 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.866770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 253/496] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:48.866770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87b51-97cd-4cc4-98c7-8865f82502a7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:48.873118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb655d-b422-4964-b422-4f77bf187ec8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:48.904053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:48.904675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.904950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.905242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.905948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:48.906245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:48.907629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8777247-581c-469c-b3ac-ee8c1a413065 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:48.919022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 244/497] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:48.920242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5333073-e15a-4613-af07-77f614dab278 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:48.920529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5333073-e15a-4613-af07-77f614dab278 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:48.920856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5333073-e15a-4613-af07-77f614dab278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:48.936554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f5333073-e15a-4613-af07-77f614dab278 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:48.937728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f5333073-e15a-4613-af07-77f614dab278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:48.968834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87b51-97cd-4cc4-98c7-8865f82502a7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.000447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.001233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.001506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.001811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.009281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.010738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.012004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 245/498] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:49.012841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5333073-e15a-4613-af07-77f614dab278 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-f45ce6f4-7647-45f2-bd44-1f58f9fe2be8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:49.037724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:49.038860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:49.039939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 254/499] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:02:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:49.040527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a465-397c-4304-b751-af90d772bb7d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.040596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a465-397c-4304-b751-af90d772bb7d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.040842 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116a465-397c-4304-b751-af90d772bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.058250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8116a465-397c-4304-b751-af90d772bb7d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:49.059469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8116a465-397c-4304-b751-af90d772bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:49.117857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5333073-e15a-4613-af07-77f614dab278 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.122088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 255/500] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:49.131194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a465-397c-4304-b751-af90d772bb7d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.153428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.154209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.154557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.154914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.155748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:49.156036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.157411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.165288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 246/501] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:49.166036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.217155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116a465-397c-4304-b751-af90d772bb7d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.250902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.251709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.251983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.252248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.257379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820acc4-e6c6-4403-95eb-4a5ade3ca1b5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.259430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.260893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:49.275597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:49.276645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 08:02:49.277861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:49.278837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 256/502] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:49.279687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.290085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.290817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.291134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.291413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.302010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.303600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:49.322918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:49.323897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:49.324976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:49.324976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:49.324976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:49.324976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:49.324976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 247/503] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:49.327163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.382111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65210a-ddda-4902-9268-6466e930b88d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.416323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.416991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.417264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.417527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.418350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:49.418646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.420116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.430729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358fd46-f396-42df-8810-764b2e960a7e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.455461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 257/504] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:49.456267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.463070 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.463872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.464150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.464420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.474813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:49.482725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:49.483811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:49.484619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 248/505] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:49.485304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.554047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f034-4bba-48e5-9ee6-fc53c418958b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.586898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dae1c5-2fab-4e9f-aa31-54b8d16f06f2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.587627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.588412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.588686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.588931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.598756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.600353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:49.617460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:49.618331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:49.619231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:49.619231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:49.619231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:49.619231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:49.619231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 258/506] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:49.619494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.623783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.624452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.624719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.624975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.625804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:49.626106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.627614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.663314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 249/507] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:49.663926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.718380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12aabd-087e-44b9-b5f4-a78182dcc9e4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.749181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.749833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.750110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.750379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.751119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:49.751416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.752811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.760400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d850b52-fed5-4ebc-ab88-6f6c9500635c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.764140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 259/508] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:49.765031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.794662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.795334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.795642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.795977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.857496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89ae16-d153-45dd-93a4-435c0705f123 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:49.860779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.862224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.888977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:49.889650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:49.889921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:49.890182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:49.890933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:49.891220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:49.892573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:49.900009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 260/509] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:49.900764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.956787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 250/510] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:49.957683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:49.998685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0bd30-472f-4fc8-bd8e-39361301de0c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.029510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.030205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.030480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.030744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.031478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:50.031772 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.033126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.044126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 261/511] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:50.044856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.052043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d440c-1bd1-4e7f-87b3-291a47bf8cc0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.085130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.085805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.086082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.086349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.139684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4bf5d-c431-4baf-9155-08955f5b0211 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.156983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.158434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.173368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.174028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.174307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.174572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.175297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.176722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.197821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 262/512] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:02:50 2022] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:02:50.198624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.273600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 251/513] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:50.274517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.306093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc1453-9bd4-4187-96be-edbe5c59ba62 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.349983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.350809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.351274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.351554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.366062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.367862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.383395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f5985-00ee-4479-8bc3-9bc235107ce5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:50.386573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:50.387464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:50.388326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:50.388326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:50.388326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:50.388326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:50.390343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 263/514] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:50.391354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.421516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.422322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.422596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.422862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.437319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.438840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:50.456838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:50.457717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:50.458749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:50.458749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:50.458749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:50.458749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:50.458749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 252/515] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:50.459041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.503450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa09ebf-f500-4f40-ac1a-b747cebdaa33 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.536873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.537652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.537926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.538192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.546282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.547779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:50.561649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:50.562767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 264/516] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:50.563729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.576225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b403fb-0f86-448c-bd57-7f934be5c2d6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.611259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.612062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.612341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.612611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.623056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.624602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:50.641407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:50.642278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:50.643181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:50.643181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:50.643181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:50.643181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:50.643181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 253/517] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:50.643447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.664002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c425c1-b391-491e-9079-e4fe7417978b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.702706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.703391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.703668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.703942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.704665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:50.704965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.706379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.723091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 265/518] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:50.723732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.745323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382178f8-8a65-408a-ba4e-c22f947ca080 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.777361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.778092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.778302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.778574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.779324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:50.779629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.781098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.797626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 254/519] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:50.797626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.821143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff168f-a2e4-46d5-9fb7-30e14f46ca15 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.853260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.853925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.854204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.854476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.855338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:50.855642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.857073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.873510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 266/520] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:50.874383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.890565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996936-3023-4132-aec5-86f2037fd5d2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:50.925013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:50.925590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:50.925863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:50.926136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:50.926915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:50.927176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:50.928539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:50.944105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 255/521] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:50.944105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:50.987052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed106ed-b8df-47e7-ad88-50571b019b89 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.021712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.022638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.022900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.023186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.030786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.032273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.042833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a000-c0b3-4d3a-8cea-37b308dbda86 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:51.051471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:51.052561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 08:02:51.053707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:51.059213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 267/522] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:51.060038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.081372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.082542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.083056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.083543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.090176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.091763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:51.106177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:51.107141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:51.108015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 256/523] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:51.108582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.165248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8aca0-1642-49f0-8c9f-47897bcc76dc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.199874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.200438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.200714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.200976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.203110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3719074-6baa-4a18-a484-2d6995cbd773 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.239398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.240202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.240484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.240756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.247518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.248953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:51.262370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:51.263326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:51.264402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:51.268422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 257/524] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:51.268813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.269335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.270685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.367848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 268/525] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:51.369032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.369629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac2f2b-ee4b-48f9-bb40-0f56fd1c2277 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.412214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.412896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.413241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.413440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.414281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:51.414586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.416055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.433132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 258/526] 10.222.0.59 () {56 vars in 1139 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:51.433925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.469503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c0e26-9774-4692-acbf-65a8f5e0f5f8 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.501655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.502308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.502587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.503099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.503661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:51.503959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.505397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.523664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 269/527] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:51.524766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.527523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9534-553a-4ec9-8a5f-139f02e23970 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.560877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.561608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.561878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.562145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.562933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:51.563245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.564675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.582650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 259/528] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:51.583508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.632408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b0b7-3c5a-4e6b-ad49-811aab4ba8cb None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.665441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.666285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.666567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.666836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.676654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.678112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.679532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a63985-ec07-41ad-8127-45010a671ab4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:51.695543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:51.696414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:51.697305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:51.697305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:51.697305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:51.697305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:51.697305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 270/529] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:51.697585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.718036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.718686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.718995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.719267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.785508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.786897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.793694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e842c5-ff9a-4154-bd6f-28aa96ce0a0b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.826058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.826711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.827080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.827349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.828175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=268f6afa0af84c6b9a6807975bb8db87) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:51.828475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.829929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:51.846913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 271/530] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/role_assignments?user.id=268f6afa0af84c6b9a6807975bb8db87&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:51.846913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.889532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 260/531] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:51.890525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:51.950169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc98bd-cda0-4463-a761-299adbaa933b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.991649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:51.992492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:51.993089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:51.993351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:51.994475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=5a8dcc7e7ecb48c7b89845bbd9babbeb) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:51.994786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:51.995698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef04ad-2450-4661-9756-804e8930cfb6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:51.996302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.003916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 272/532] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/role_assignments?user.id=5a8dcc7e7ecb48c7b89845bbd9babbeb&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:52.004901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.060674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.061337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.061619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.061890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.062842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:52.062974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.064341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.081824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 261/533] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:52.083248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.166553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58719890-27b8-41f7-9515-0783df5677ab None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.203479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2875e2-20d6-47aa-b757-d0cf086c5121 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.231255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.232070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.232345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.232666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.258606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.260117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.283787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.284611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.284888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.285160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:52.286301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:52.287199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:52.288150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:52.288150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:52.288150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:52.288150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:52.288369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 273/534] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:52.293913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.302254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.303826 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:52.340035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:52.342053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:52.344219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:52.347240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 262/535] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:52.364692 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.455309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e420f-f0ca-4b7d-adc9-8b32d08c2201 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.497015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.497976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.498254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.498527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.499731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:52.500041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.502180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126c2f4-2176-4e89-b655-04cdf555a3c3 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.503858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7473-b374-48c6-93bb-3a1cb6cf8e5b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.515908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 274/536] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:52.517616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812dead-2f3f-4e8b-815c-ef71916f14a7 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.517902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812dead-2f3f-4e8b-815c-ef71916f14a7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.518175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812dead-2f3f-4e8b-815c-ef71916f14a7 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.519671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 275/537] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:52.521232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812dead-2f3f-4e8b-815c-ef71916f14a7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.543440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.544096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.544369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.544635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.545409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:52.545831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.547286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14543e-7d79-44b1-8ad7-5afb83c65db7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.558548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 263/538] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:52.559757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.560041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.560310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.579130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:52.580282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:52.648094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 264/539] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:52.648934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.663922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812dead-2f3f-4e8b-815c-ef71916f14a7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.704318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.705110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.705383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.705644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.712434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.713876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:52.728099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:52.730058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:52.732157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 276/540] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:52.738900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.766664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fa74e-38f0-4de2-a500-cae23f580571 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.802907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.802907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.802907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.802907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.804104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=df742434fdab408581ad24749c6c9331) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:52.804104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:52.804929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:52.815031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 265/541] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/role_assignments?user.id=df742434fdab408581ad24749c6c9331&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:52.815971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.836275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf6e69-c71d-4b29-b722-4007f1365374 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.880367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.881186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.881456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:52.881728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:52.912021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:52.927874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:52.930017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:52.931981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 277/542] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:52.939918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:52.960458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111306-9d9a-4601-8d1d-dc4b64281e7c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:52.998635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:52.999415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:52.999688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:53.000002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:53.001074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:53.001376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:53.002821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:53.017734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 266/543] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:53.023566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:53.140076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b814b3-82d7-4711-87f8-b5ef5b33388a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:53.163805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431077bf-2766-4b61-a85b-ead2e54cd433 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:53.180310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:53.180963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:53.181235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:53.181502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:53.182323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=446b8ea1e1a44ab6b6b2cd4ca5a77b04) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:53.182623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:53.184071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:53.190952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 267/544] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:53 2022] GET /identity/v3/role_assignments?user.id=446b8ea1e1a44ab6b6b2cd4ca5a77b04&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:53.252770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:53.253403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:53.253679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:53.253949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:53.254718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:53.255047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:53.256478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:53.270321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 278/545] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:53.277051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:53.424078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1f5a2-363d-4b57-a0ab-693df4e77373 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:53.457173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:53.457965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:53.458237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:53.458503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:53.470004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:53.471548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:53.489191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:53.491219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:53.493237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:53.493237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:53.493237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:53.493237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:53.493237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 268/546] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:53.499973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:53.646304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed444a-9e37-4947-99da-cf74aca8091d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:53.691650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:53.692980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:53.693454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:53.693917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:53.694853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:53.695390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:53.696987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:53.709926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 279/547] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:53.715552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:53.832995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059930-6dfb-46f4-b8bc-fc441af48a68 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:53.870391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:53.871218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:53.871499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:53.871768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:53.882423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:53.883937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:53.902016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:53.903062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:53.903992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 269/548] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:53.909363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:54.028694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28456b40-2614-425a-93c6-f842054ccdde None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:54.068155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:54.069203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.069699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.070178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.071239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:54.071737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:54.073393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913d14b-9750-4eee-8cef-5aab7ac50272 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:54.094528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 280/549] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 4 08:02:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:54.099944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:54.253587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c67b1-ddae-47bb-8da3-84f60e03adb9 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:54.303853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:54.304452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.304732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.304998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.398366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:54.399840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:54.481277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6422d-2477-4a27-b4a9-4094ed5d0da6 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.481859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6422d-2477-4a27-b4a9-4094ed5d0da6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.481859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6422d-2477-4a27-b4a9-4094ed5d0da6 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.483529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 281/550] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:54.497838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.498163 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.498387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.523681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:54.524851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:54.570072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 270/551] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:02:54.579139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:54.649223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 282/552] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:02:54.684018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:54.712474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab911af0-0598-4490-b7b6-47a21ca9053b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:54.746162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:54.747037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.747271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.747547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.759451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:54.760410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-78cb340f-7e57-470a-af32-f215b342cbda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:54.779558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:54.780540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:54.781413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:54.781413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:54.781413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:54.781413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:54.781413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 271/553] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:54.782108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f89b0-bf58-44df-b9be-a6be2212d706 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.782296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f89b0-bf58-44df-b9be-a6be2212d706 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.782568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f89b0-bf58-44df-b9be-a6be2212d706 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.788130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 272/554] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:54.788130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f89b0-bf58-44df-b9be-a6be2212d706 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:54.798224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857db50-f2a1-49d0-97e8-c79377e171ac None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:54.833208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1143d-2703-4ccf-955d-5ad14c824b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:54.834407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1143d-2703-4ccf-955d-5ad14c824b7d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.834909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1143d-2703-4ccf-955d-5ad14c824b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.835423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1143d-2703-4ccf-955d-5ad14c824b7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.846118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1143d-2703-4ccf-955d-5ad14c824b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-79f1143d-2703-4ccf-955d-5ad14c824b7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:54.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:54.855008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:54.855865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:54.858348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 283/555] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:02:54.859835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.860333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.860798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.877335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:54.878794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:54.887202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f89b0-bf58-44df-b9be-a6be2212d706 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:54.920945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:54.921606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:54.921903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:54.922397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:54.922873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:54.923199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:54.924580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:54.936259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 273/556] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:54.937191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:54.954982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 284/557] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:54.956148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.035763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce915f-7c85-4ce4-9da8-252987479566 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.069507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.070179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.070460 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.070733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.071507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:55.071811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.072157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdec25-b373-4eac-9888-0d7903e36cd9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.073366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.082063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 274/558] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:55.082778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.107264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.108443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.108920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.109387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.116589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.118350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:55.132494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:55.133450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:55.134307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:55.136742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 285/559] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:55.137780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.181673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4705c91-3646-499e-b90a-fb2bcdb31617 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.215633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.216437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.216716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.216988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.227689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:55.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:55.236546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:55.237362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 275/560] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:55.238023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.247116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32ed4-8210-4b1f-8e25-c35f07e49972 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.280960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.282212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.282698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.283224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.295344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.297456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:55.316530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:55.317457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:55.319171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:55.319171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:55.319171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:55.319171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:55.321468 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 286/561] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:55.322586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.345139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9b4ab-80fd-42d8-90de-38fbcf9aa9ac None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.378992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.379578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.379882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.380155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.381010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:55.381293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.382809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.395956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 276/562] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:55.396958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.428956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198135c5-4d8b-496f-8718-4e52e63c1df7 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.463546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.464496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.464955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.465411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.466332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:55.466809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.468437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.481468 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 287/563] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:55.483214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.497183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8879a-25d4-4d47-a0e6-26cd6dfe4569 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.530901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.531587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.531870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.532148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.532867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:55.533175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.534561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.549983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 277/564] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:55.549983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.588314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4cf6a-eefb-4df1-aa64-9ff09a68595b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.622254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.622928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.623213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.623502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.624334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=fce6f00e1a97411fa0c248a8f08b2256) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:55.624640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.626076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7206b1-1557-4ff9-81fe-e87aab04a764 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.631692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 288/565] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/role_assignments?user.id=fce6f00e1a97411fa0c248a8f08b2256&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:55.633215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e68ff-fab1-4093-b446-73626df5d297 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.633557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e68ff-fab1-4093-b446-73626df5d297 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.633895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e68ff-fab1-4093-b446-73626df5d297 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.635432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 289/566] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:55.641037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e68ff-fab1-4093-b446-73626df5d297 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.665546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ed0e9-58c6-481b-990c-4d9b0541c014 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.712254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159367-6530-4474-9818-27598db18339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.713127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159367-6530-4474-9818-27598db18339 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.713408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159367-6530-4474-9818-27598db18339 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.713681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159367-6530-4474-9818-27598db18339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.732468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159367-6530-4474-9818-27598db18339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.732677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159367-6530-4474-9818-27598db18339 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-55159367-6530-4474-9818-27598db18339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:55.754165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:55.755311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:55.756208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:55.756208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:55.756208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:55.756208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:55.758639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 278/567] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:55.760285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.760775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.761274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.779709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:55.781332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:55.797645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e68ff-fab1-4093-b446-73626df5d297 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.833465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:55.834279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:55.834554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:55.834822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:55.843049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:55.844507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:55.857359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 279/568] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:55.859011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:55.859948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:02:55.860966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:55.862356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.864936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 290/569] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:55.871997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:55.966425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d414e92-e814-41e9-83f0-fcf4ac30a44d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.974242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326bd7-1697-457a-a77d-ee4e34ef416f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:55.999750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.000408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.000685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.000952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.001667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:56.001969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.003363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.009117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.010109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.010109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.010293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.011135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:56.011434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.012840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa02b0-9564-451a-990a-bc9faa7caba0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.019460 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 280/570] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:56.019460 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.040385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 291/571] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:02:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:56.040385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eae9a-c9c3-4bf6-be11-a21f6d0cd994 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.040385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eae9a-c9c3-4bf6-be11-a21f6d0cd994 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.040385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eae9a-c9c3-4bf6-be11-a21f6d0cd994 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.040385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 292/572] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:56.040385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eae9a-c9c3-4bf6-be11-a21f6d0cd994 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.120789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151c71-c655-493a-9393-45690bb852aa None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.151986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eae9a-c9c3-4bf6-be11-a21f6d0cd994 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.153405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.154213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.154478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.154756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.164728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:56.172366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:56.173857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 281/573] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:56.174740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.187097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.187888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.188155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.188416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.195820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.197611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-7f255e17-142a-49ec-ad32-aea3b134d96c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:56.211485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:56.217297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 293/574] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.218860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.219915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.231635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:56.233177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:56.284040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5b809-1c96-4a76-ab49-8940b4c5ae8d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.300149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 294/575] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:56.301172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.326949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.328008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.328427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.328868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.339780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.341458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:56.359236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:56.360192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:56.361102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:56.361102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:56.361102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:56.361102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:56.361102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 282/576] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:56.361473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.403829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2848f6-2e69-4342-a2a7-3db165bfd9f5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.436316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.437024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.437306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.437574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.438318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:56.438616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.440042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.453593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 295/577] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:56.453593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.475271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72f11-917e-4077-8968-b83d391c8a58 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.512486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.513423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.513700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.513969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.514850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:56.515198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.516794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.538720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 283/578] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:56.538720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.555925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c4c08-60ca-4cd1-ae55-1d6dad3021fa None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.597561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.598577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.598859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.599161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.611760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:56.619496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:56.620481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:56.621341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 296/579] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:56.622243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.642635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b463-8d58-45b9-8702-6a7e8ead542b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.680584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.681253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.681533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.681804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.682525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:56.682825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.684212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.700936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 284/580] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:56.700936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.744032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b27162-fdaa-4dfd-8866-9fae712e5d1f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.778011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.779150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.779568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.780061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.791697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.793163 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.802302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc581d-96a7-4c04-8aac-138a1bf7c465 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:56.810001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:56.810913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:56.817007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:56.817007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:56.817007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:56.817007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:56.817007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 297/581] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:56.817007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.838036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.838829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.839123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.839409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.849901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.851379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:56.869094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:56.869994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:56.871058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:56.871058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:56.871058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:56.871058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:56.871058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 285/582] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:56.871812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.921361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f1de2-3ec8-45c9-8cd1-caa37353913b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:56.953686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:56.954644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:56.954952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:56.955222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:56.955960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:56.956257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:56.957620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:56.970060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 298/583] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:56.970060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:56.970493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad5a0-e460-47d4-8757-99b2e7e27a63 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.002408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.003162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.003440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.003708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.010392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.011860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:57.025898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:57.027045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:57.028126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 286/584] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:57.032558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.066269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996b3a-31b6-4094-b26f-60b2a3287b8b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.099773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.100441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.100723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.100990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.101715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:57.102016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.103448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.119092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 299/585] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:57.119092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.127711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75931a27-3c7f-4195-b491-c08825b910b4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.166856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.167333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.167616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.167889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.168662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:57.168913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.170286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.181458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 287/586] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:57.182286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.220971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347b99d-6dc6-469d-be46-28014d113094 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.255500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.256547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.256991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.257405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.269280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.271043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.283431 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfd7e-fd6a-449a-85f6-4d60fb5d7860 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:57.289004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:57.290057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:57.291190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:57.291190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:57.291190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:57.291190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:57.295109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 300/587] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:57.296004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.319999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.320948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.321399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.321811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.322734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:57.323230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.324800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.337170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 288/588] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:57.338158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.397192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d339e14-e064-426a-804e-2c23ae0b7a86 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.433123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.433920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.434201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.434851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.444356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.446110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.446800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0495da-21f0-4b9f-b218-3c02908ee2cb None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:57.464227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:57.465336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:57.466308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 301/589] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:57.467544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.485717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.486480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.486756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.487060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.493743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.495192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:57.508727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:57.509661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:57.510661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:57.514776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 289/590] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:57.515414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.577365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28022c-220e-4b89-84af-548e1421b089 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.610537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.611225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.611502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.611773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.611888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4bccb-76e5-42f1-8403-278d8a3e8f31 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.612489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:57.612787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.614174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.625626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 302/591] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:57.626622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.651562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.652609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.652886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.653455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/268f6afa0af84c6b9a6807975bb8db87/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.670608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=268f6afa0af84c6b9a6807975bb8db87, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.672174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.684776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 290/592] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:57 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/268f6afa0af84c6b9a6807975bb8db87/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:57.685563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.748062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cf9b1-b966-4ffb-b27e-8c63d68aa1b2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.789212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.790148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.790572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.791034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.792061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:57.792528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.794332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.814716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 303/593] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:57.816247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.834252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fb146-ec96-42c1-a1fe-68bd4877f2eb None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.876580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.877547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.877958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.878375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.879367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:57.879867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.881444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.897200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 291/594] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:57.898288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.923050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f32b2e-c6a4-4b9b-bd0e-cfa907df9a8b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:57.956932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:57.957731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.958011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.958280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.965586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:57.967196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c7d01cbc-b9ef-4bc8-82f5-adf65adf93a7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:57.981667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:57.982671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 08:02:57.983703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:57.987898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 304/595] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:57.989143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224be62-bf11-4b77-972f-ad8583f94647 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:57.989432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224be62-bf11-4b77-972f-ad8583f94647 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:57.989708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224be62-bf11-4b77-972f-ad8583f94647 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:57.991140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 305/596] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:02:57.995167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224be62-bf11-4b77-972f-ad8583f94647 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:57.997644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46a5ce-3912-4f64-9438-6181947c2c0d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.030659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.031487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.031762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.032031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.043785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.045169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:58.061948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:58.062934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:58.065014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:58.065014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:58.065014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:58.065014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:58.065014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 292/597] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:58.065014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.100804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224be62-bf11-4b77-972f-ad8583f94647 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.133890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057465f4-9f61-4f51-9fe4-06bcc88fb226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.135121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057465f4-9f61-4f51-9fe4-06bcc88fb226 None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.135688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057465f4-9f61-4f51-9fe4-06bcc88fb226 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.136145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057465f4-9f61-4f51-9fe4-06bcc88fb226 None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/5a8dcc7e7ecb48c7b89845bbd9babbeb/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.152038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057465f4-9f61-4f51-9fe4-06bcc88fb226 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=5a8dcc7e7ecb48c7b89845bbd9babbeb, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.153486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057465f4-9f61-4f51-9fe4-06bcc88fb226 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df866b08-6026-4ed1-8cbd-0103f3fa09c7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.167615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 306/598] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:57 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/5a8dcc7e7ecb48c7b89845bbd9babbeb/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:58.169320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.169606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.169879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.203843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:02:58.205432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:02:58.206691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.207522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.207875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.208206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.210346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:58.210747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.212320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.237491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 293/599] 10.222.0.59 () {56 vars in 1139 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:58.238671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.289633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 307/600] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:02:58.291058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.361792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f0fa2-a402-407d-98bf-f497d7d48e5e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.412542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.413761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.414184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.414589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.416140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:58.416610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.418689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.433881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 294/601] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:58.435263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.438545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc267-39be-4415-afd4-fb12e0001496 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.479228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.480129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.480477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.480811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.493553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.495440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:58.517918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:58.519072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:58.520189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:58.520189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:58.520189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:58.520189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:58.521213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 308/602] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:58.523704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.554935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58102ce-1fd4-42c1-931c-c42ce11758e3 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.601152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.602024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.602350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.602625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.613618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:02:58.621438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:58.622382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:58.623271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 295/603] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:58.623999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.649278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af0b48-2c63-43ba-a0ad-903db0be67d4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.683258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.684072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.684360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.684629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.691761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.693526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:58.707104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:58.709100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 309/604] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:58.711260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.740988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3269453-b282-4a87-bb00-2e7950ec9854 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.782418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.783143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.783425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.783697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.784820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:58.785135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.786897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.802976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 296/605] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:58.803857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.817249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899abecd-16cc-4e0e-bdd5-6e986ef37cf9 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.864370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.865266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.865820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.866095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.866857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:58.867203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.869313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.880027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 310/606] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:58.881266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:58.903181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672522d-2a8c-4dda-9d23-e8556deacb90 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:58.939061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:58.939880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:58.940220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:58.940629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:58.941529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:58.941933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:58.943755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:58.957950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 297/607] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:58.958665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.005519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0014e-beb8-46b4-96cc-d07ad1759f1b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.048390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.049512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.050054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.050329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.057347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfdba0-731c-4057-8a8b-82d6e4f3d842 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.058544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.061043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:02:59.078672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:59.080141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:02:59.081894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:59.086948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 311/608] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:59.086948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.096807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.097741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.098115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.098518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.109384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.110966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:02:59.127879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:59.128978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:59.130709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:02:59.130709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:02:59.130709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:02:59.130709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:02:59.135642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 298/609] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:59.135642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.192059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62e63-5ee3-446d-82f9-ded4ce6e65ba None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.226618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.227575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.227817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.228101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/df742434fdab408581ad24749c6c9331/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.239752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f6f07-6c49-48d0-bff2-419ee1db683a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.243111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=df742434fdab408581ad24749c6c9331, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.244565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.261136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 312/610] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:59 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/df742434fdab408581ad24749c6c9331/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:59.262057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.316395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.317137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.317423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.318005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.319170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:59.319170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.320621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.353578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 299/611] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:59.359277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.386868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62675af-edca-4dd9-be2a-58b256cbc08a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.428277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.429542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.430041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.430500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.431490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:59.431999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.433592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.447987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 313/612] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:02:59.454119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.574750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0abc3-d607-456b-8511-4d5583553c00 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.581175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95eda-7001-4a00-a0cd-1f0cb8b67b7c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.615871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.616671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.616951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.617225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.617780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.618615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.618904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.619190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/446b8ea1e1a44ab6b6b2cd4ca5a77b04/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.628002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.629928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.638604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=446b8ea1e1a44ab6b6b2cd4ca5a77b04, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.640029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:02:59.646682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:02:59.648173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:02:59.649934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 314/613] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:02:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:02:59.656675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.660370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 300/614] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:02:59 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/446b8ea1e1a44ab6b6b2cd4ca5a77b04/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:02:59.774467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25d5d-ddfc-4b72-baf4-29979c045b66 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:02:59.810482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:02:59.811340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:02:59.811656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:02:59.811934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:02:59.812812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:02:59.813168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:02:59.814700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:02:59.835789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 315/615] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 4 08:02:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:02:59.843272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:02:59.988591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46535237-5666-4206-9ef0-d62c5206e12f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.036471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.037529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.037956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.038405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.054056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:00.055709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-4403f2ff-0c54-4c36-9525-751e421daa32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:00.077944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:00.083608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:00.084724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:00.084724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:00.084724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:00.084724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:00.086317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 301/616] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:00.092183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.172262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b1e3-0a06-4f91-ae9c-456165908e90 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.172543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b1e3-0a06-4f91-ae9c-456165908e90 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.172811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627b1e3-0a06-4f91-ae9c-456165908e90 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.174151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 302/617] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:00.184202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.184434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.184700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.213942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:00.215160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:00.263866 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee179684-934f-40ad-bed4-eb9e7e82f091 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.315355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.316175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.316452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.317026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.318311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:00.318611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:00.320545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:00.328349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 303/618] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:03:00.340037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 316/619] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:00.345594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.361500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.526031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4720a4-6310-4abf-95d3-896bda114268 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.567059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4844e4-5676-40aa-8f50-9244b55a4b4f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.589927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.594937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.594937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.594937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.601089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:00.603242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a179aa5a-9ce7-4da9-ae6e-e583b22e08a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:00.622932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:00.624007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 304/620] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:00.624902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2eecff-4b3a-46a9-a56f-9daabf03577e None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.625449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2eecff-4b3a-46a9-a56f-9daabf03577e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.625449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2eecff-4b3a-46a9-a56f-9daabf03577e None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.635166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 305/621] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:00.636434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2eecff-4b3a-46a9-a56f-9daabf03577e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.640794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a371fd-7237-4239-a9f3-8a440dd32545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.641599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a371fd-7237-4239-a9f3-8a440dd32545 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.641883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a371fd-7237-4239-a9f3-8a440dd32545 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.642153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a371fd-7237-4239-a9f3-8a440dd32545 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.653574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a371fd-7237-4239-a9f3-8a440dd32545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-79a371fd-7237-4239-a9f3-8a440dd32545 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:00.661449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:00.662599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:00.663647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:00.667655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 317/622] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:00.668953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.669236 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.669507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.687378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:00.688827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:00.759580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2eecff-4b3a-46a9-a56f-9daabf03577e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.772820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 318/623] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:00.773751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.807191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.807781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.808057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.808326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.810190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:00.810497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:00.811987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:00.824827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 306/624] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:00.825712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.885793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73a235-a16b-4c2f-bda7-a0f4b094a49d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.924643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.925721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.926199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.926699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.927170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae69078-ba8d-4241-8b37-5dfd9cc4d9ba None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:00.928004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:00.928505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:00.930092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:00.943212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 319/625] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:00.944326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:00.961319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:00.962127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:00.962401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:00.962668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:00.973338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:00.981020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:00.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:00.983063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:00.987075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 307/626] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:00.987960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.049974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2c360-9ef4-47ff-bc56-d55dd129f187 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.084716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.085958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.086303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093b0cc-1452-4f2b-8cab-2095ebe1613b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.087107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.087579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/fce6f00e1a97411fa0c248a8f08b2256/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.102614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=fce6f00e1a97411fa0c248a8f08b2256, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.104414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.119802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.120654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.120929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.121212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.122180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 320/627] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:00 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/fce6f00e1a97411fa0c248a8f08b2256/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:03:01.123585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.134653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.136252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:01.154462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:01.155626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:01.156552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:01.156552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:01.156552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:01.156552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:01.160572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 308/628] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:01.162109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.258969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537214d-6bdd-48c3-970e-0fc71f3ff379 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.267005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993ffe1-41ac-4c6b-b3e1-e443a6416e22 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.293312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.293667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.293875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.294145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.294919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:01.295264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.296670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.310152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.310392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 321/629] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:01.311370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.311569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.312126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.312595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.313519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:01.314189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.316614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.334309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 309/630] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:01.346850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.441022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150de0b3-ac8e-4e30-8c51-c72f41295b60 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.480381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.481325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.482327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.482616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.496055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.498118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.516425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853053b-63df-4897-8a21-4421e9b7b250 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:01.519614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:01.520653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:01.521557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:01.521557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:01.521557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:01.521557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:01.521557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 322/631] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:01.529755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.578104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.578923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.579205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.579471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.589057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.590491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:01.614988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:01.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:01.619560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 310/632] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:01.625926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.709717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad051f-1580-4914-babc-abfe507911ff None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.780621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.781303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.781559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabff30a-1bd4-4b0b-b35d-645f24ce25b4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.781739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.781891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.782553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:01.782856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.784256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.813409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 323/633] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:01.819758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.822080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:01.822767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:01.823073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:01.823346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:01.824378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:01.824685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:01.826244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:01.846567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 311/634] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:01.851674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:01.966368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b13ce-0e44-4680-830d-c420aa98637e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:01.967392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97759c95-ce66-41eb-bb2e-449bf13753d2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.007541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.008916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.009484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.009969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.011453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.012169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.012682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.013017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.018356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.020089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-609f14ae-a18b-45d6-8db8-4e12f15365ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:02.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:02.036565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 08:03:02.037748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:02.040222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 324/635] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:02.041710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95c994-a062-4502-951f-6bd84eb41bfd None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.042159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95c994-a062-4502-951f-6bd84eb41bfd None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.042548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95c994-a062-4502-951f-6bd84eb41bfd None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.048403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 325/636] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:02.049951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.050444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.050943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.071101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:02.072611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:02.097422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.099079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.143125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 326/637] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:02.144354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.220240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 312/638] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:03:02.221479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.267355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483881-8473-4fff-bf01-6d3ff751c1ad None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.302088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.303136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.303671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.304138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.305154 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:02.305665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.307323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.325771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 327/639] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:02.327041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.345940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21760e-78fc-4a49-a842-ac57f526b29f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.392566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.393372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.393647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.393909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.408523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:02.416223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:02.417197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:02.418084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 313/640] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:02.419433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.439902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d673fb-4e87-432c-b17f-7a360bcd07b7 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.473055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.473924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.474499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.474770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.488146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.489697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-6c1dce2f-81b1-4a5c-94c4-609128822e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:02.512107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:02.513162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:02.514246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:02.514246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:02.514246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:02.514246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:02.514246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 328/641] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:02.515350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139b496-dbb6-4b7a-811c-8e927d4a774e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.515350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139b496-dbb6-4b7a-811c-8e927d4a774e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.515350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139b496-dbb6-4b7a-811c-8e927d4a774e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.516515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 329/642] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:02.519904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139b496-dbb6-4b7a-811c-8e927d4a774e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.521292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdab98-5bd6-4ee5-b977-69a86c591d87 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.554463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4fd3-9fb1-431c-9f04-e5836a73098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.555131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4fd3-9fb1-431c-9f04-e5836a73098a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.555410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4fd3-9fb1-431c-9f04-e5836a73098a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.555676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4fd3-9fb1-431c-9f04-e5836a73098a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.623595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4fd3-9fb1-431c-9f04-e5836a73098a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.623934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139b496-dbb6-4b7a-811c-8e927d4a774e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.625074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4fd3-9fb1-431c-9f04-e5836a73098a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.662693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.663641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.664060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.664529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.665268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:02.665567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.666971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.676084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 330/643] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:02.676859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.735568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 314/644] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:03:02.735568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.735568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.735568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.749381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:02.750529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:02.776653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687e37b-3823-403f-a5e3-6bf96a2a96af None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.810373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.811137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.811417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.811684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.812391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:02.812688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.814045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.817810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 315/645] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:02.818914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.830063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 331/646] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:02.830063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:02.924131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf12c6-a1d4-4384-9dbf-f64dd2b866ba None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.936197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa40f0-be17-48ad-bccb-be584c30cca0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:02.958674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.959507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.959786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.960043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.969923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.970769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:02.971377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.972049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:02.972466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:02.972888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:02.984435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:02.986258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:02.988518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:02.989573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:02.990733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:02.990733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:02.990733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:02.990733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:02.990733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 316/647] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:02.991082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:03.010130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:03.011122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:03.012036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:03.012036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:03.012036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:03.012036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:03.016041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 332/648] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:03.016643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.091783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f3707-6878-4a64-b79e-3c94666d236d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.112961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae794211-e117-46da-855b-1a202f5c8713 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.123520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.124310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.124581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.124842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.131549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.132970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.145086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.145882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.146160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:03.146258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:03.147164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:03.148670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:03.149136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.149208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 317/649] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:03.149208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.162015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:03.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:03.171053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 333/650] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:03.172107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.249216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67bb1e-e833-4384-b24a-d15bd29af11e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.271462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590350e-7459-4b65-bb94-98114d9af29c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.284263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.285183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.285758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.286094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.286807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.287152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.288520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.304525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 318/651] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.304525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.310689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.311459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.311731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.312006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.312765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.313065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.314438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.326725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 334/652] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.327623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.421477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e26f8-4554-486a-8211-146f099f4932 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.435545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad973a3b-a805-4135-853c-aa5a2d34a9eb None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.459510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.460174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.460454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.460713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.461500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.461800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.463241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.474684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 319/653] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.475522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.480912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.481805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.482258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.482755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.483700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.484564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.486452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.500117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 335/654] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.500117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.576149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a356e-7e80-4e2d-9ae6-ae87961e74b6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.594387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62766ca0-9bf6-494d-97cc-72a5e5db7b44 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.608916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.609932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.610080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.610298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.618761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.620262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.625734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.626526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.626801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.627166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.633693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:03.634019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:03.635208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:03:03.636765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:03.637550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.639273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 320/655] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:03.639965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:03.650245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:03.651454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 336/656] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:03.652496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.741688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d99df-c7f3-467f-9b9a-c3da05b28db0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.748730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6782b2-8930-4c81-99c1-56f23430dd5a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.774915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.775508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.775786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.776058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.776882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=268f6afa0af84c6b9a6807975bb8db87) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.777186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.778618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267a307-3c42-4c12-9498-6e5986aab78a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.782652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.783472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.783747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.784012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.784274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 321/657] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/role_assignments?user.id=268f6afa0af84c6b9a6807975bb8db87&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.785518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84133ed-fb44-4cfc-b124-1a8b0d07d3b9 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.785787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84133ed-fb44-4cfc-b124-1a8b0d07d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.786087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84133ed-fb44-4cfc-b124-1a8b0d07d3b9 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.787562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 322/658] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:03.788032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84133ed-fb44-4cfc-b124-1a8b0d07d3b9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.809013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.810527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:03.831223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:03.832265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:03.833270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:03.833270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:03.833270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:03.833270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:03.833270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 337/659] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:03.835031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:03.906576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84133ed-fb44-4cfc-b124-1a8b0d07d3b9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.941545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.942224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.942815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.943119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.943212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505faa-ef51-402e-9c24-5ad434de8601 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:03.943973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.944279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.945733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e03ef-b0e3-4542-a2e4-9b3364d903a7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.965181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 323/660] 10.222.0.59 () {56 vars in 1137 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.966858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.967333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.967754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.980916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:03.981509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:03.981785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:03.982052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:03.982978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:03.983282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:03.984729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:03.986387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:03.987762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:03.997090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 338/661] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:03.997907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.061712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 324/662] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:04.062439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.107318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5c62e-d33a-49c2-b467-7f03a300c95d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.139490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.140155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.140420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.140744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.141465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:04.141787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.143195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.159449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 339/663] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:04.159449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.162593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd3df8-2802-4692-8cd4-563b5996f38e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.195735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.196386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.196692 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.196968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.251316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bc42b-1a61-46ac-a921-4e77c79f8f54 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.263170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.264646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.284398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.285159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.285508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.285838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.286726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=5a8dcc7e7ecb48c7b89845bbd9babbeb) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:04.287150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.288647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.303270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 340/664] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/role_assignments?user.id=5a8dcc7e7ecb48c7b89845bbd9babbeb&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:04.306071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.382201 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 325/665] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:03:04.386271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.445963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c20e94-c1f6-4956-abf1-3cbad53ca850 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.490958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.492351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.493018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.493429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.499693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1c6d9-b3dc-46be-8721-7f95844769d6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.507044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:04.515895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:04.517048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:04.518026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 341/666] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:04.518745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.547062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.548144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.548580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.549004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.557923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.559592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:04.577429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:04.578696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:04.579935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 326/667] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:04.581157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.645892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1915d2-0d64-491c-a5f3-2d63a3d9bfad None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.680484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.681288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.681564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.681899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.695864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.697327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.698114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e3b7-5226-4d6d-88d8-9a8efdad8c1b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:04.715213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:04.716350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:04.717504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:04.717504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:04.717504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:04.717504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:04.717504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 342/668] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:04.717843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.747363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.748758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.749445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.749866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.750860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:04.751482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.753964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.765191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 327/669] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:04.770194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.820784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0ce29-b121-40ba-84f7-67f876cef67e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.853550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.854226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.854504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.854776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.855707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:04.856440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.857381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.879484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 343/670] 10.222.0.59 () {56 vars in 1139 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:04.879484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.898081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63344b92-6579-4ba0-b331-2662718c7a10 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:04.930688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:04.931498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:04.931851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:04.932192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:04.932982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:04.933351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:04.934788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:04.947258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 328/671] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:04.948481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:04.997806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb001b9d-0df7-44c0-ae2b-784c21d63254 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.043151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.044364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.044901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33853178-9a95-4c78-86b3-101683d607e6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.045392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.046132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.062351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.064504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.082659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.083442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.083790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.084132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:05.087418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:05.088319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:05.089231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:05.089231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:05.089231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:05.089231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:05.096827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 344/672] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:05.096827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.161072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.162441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.215968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec642e9-755a-4d1d-bcc6-f43b9e19becd None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.251623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.252362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.252638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.252903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.259657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.261113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:05.275995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:05.276937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 345/673] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:05.277896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.279307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 329/674] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:03:05.281100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.389921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31678838-807f-4b82-941e-b54cfc53ed6d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.391526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4498d-916b-43c0-bc5c-7c8ba99886bf None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.431583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.432555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.432988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.433405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.434408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.435258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.435884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.436623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.437499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:05.437940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.439479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.449793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.451883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.457002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 346/675] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:05.457002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:05.476064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:05.477236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:05.478383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:05.478383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:05.478383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:05.478383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:05.484197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 330/676] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:05.484197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.580512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d91cbf-ea6a-497f-b5cf-57957832bf32 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.607015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac217ea-b420-4695-9c50-72fc653b9f65 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.614112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.614899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.615269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.615624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.616918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:05.617314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.619252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.638191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 347/677] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:05.638191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.654211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.655507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.656207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.656623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.666316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.668690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:05.687451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:05.688632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:05.689904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:05.697332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 331/678] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:05.697332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.757482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fb8c-8907-4453-ba95-5d42eb6240f2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.793576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76a5a1-352a-4735-9ef1-45e14cb2e354 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:05.802683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.803974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.804780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.805547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.806465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:05.807123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.809324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.828675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 348/679] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:05.828675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:05.837099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:05.837958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:05.838777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:05.839216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:05.840872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=df742434fdab408581ad24749c6c9331) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:05.841341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:05.843749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:05.858179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 332/680] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/role_assignments?user.id=df742434fdab408581ad24749c6c9331&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:05.859290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.016948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7e45a-8fc3-494e-b505-deddba2f02ae None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.061052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5b4f5-341c-41e7-bb8a-c1da19590460 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.089356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.090027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.090295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.090555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.092924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:06.092924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.093184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.112329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 349/681] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:06.113069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.114021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.114439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.114858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.121229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.127300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.128946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-ec4bc7ef-1962-47a4-aa0b-7465d5e2d348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:06.147358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:06.148368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:06.149508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 333/682] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:06.150186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7783a0-69bc-4109-96f5-90f0aefa80f2 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.150472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7783a0-69bc-4109-96f5-90f0aefa80f2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.150744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7783a0-69bc-4109-96f5-90f0aefa80f2 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.158130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 334/683] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:06.158130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.158130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.158434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.176322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:06.177504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:06.249119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a634-dc7d-44aa-ba20-0533902fc13f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.257916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 335/684] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 08:03:06.259032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.305747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.306390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.306948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.307077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.376152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b86490-e7ca-4bfc-b306-fc24eb2d7270 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.377823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.380047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.420990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.421869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.422629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.423068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.424338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:06.425057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.426804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.451106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 336/685] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:06.451106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.503784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 350/686] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:03:06.505503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.562230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1358e-77b6-44c8-a798-b0e8f445dcc5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.596477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.597327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.597604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.597873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.608221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:06.616117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:06.617090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:06.617942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:06.622007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 337/687] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:06.622867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.628859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dc6ce-bc66-46bc-9787-d079627eb910 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.673845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.674930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.675340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.675525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.676336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=446b8ea1e1a44ab6b6b2cd4ca5a77b04) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:06.676643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.678090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.684850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 351/688] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/role_assignments?user.id=446b8ea1e1a44ab6b6b2cd4ca5a77b04&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:06.685747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.737956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393d2c-51ab-4c8b-a725-9fa13d8091a8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.784729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.785676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.785958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.786231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.798650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.800105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-5187dc1a-2476-4053-9709-671b6e0bb1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:06.818727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:06.819731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:06.820742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:06.820742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:06.820742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:06.820742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:06.824712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 338/689] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:06.826249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af585f6-d5ea-4480-9ce1-5856c0fa1f2d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.826575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af585f6-d5ea-4480-9ce1-5856c0fa1f2d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.826849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af585f6-d5ea-4480-9ce1-5856c0fa1f2d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.827862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72efc4-f7b7-44cb-933c-c9958303f78e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.828812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 339/690] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:06.829889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af585f6-d5ea-4480-9ce1-5856c0fa1f2d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.869934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.870809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.871270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.871625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.872640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:06.873057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.874561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128afc5-1e48-43cf-be7e-789b9ccb5359 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:06.884390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 352/691] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:06.885936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.886348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.886710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.903427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:06.904771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:06.958095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af585f6-d5ea-4480-9ce1-5856c0fa1f2d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:06.977207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 353/692] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:06.978074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:06.992457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:06.993415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:06.993834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:06.994244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:06.995169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:06.995633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:06.997195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.015486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 340/693] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:07.017646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.108386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5eea6-cdca-4fbf-8064-761dbce9e8b7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.139822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b08f0-f1a3-467b-8651-c9a448ab5088 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.149654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.150777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.150777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.151061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.161605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.163186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:07.180917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:07.181878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:07.182798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:07.182798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:07.182798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:07.182798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:07.183965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.184991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.185471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.185989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.187001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 354/694] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:07.187846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.195446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.197570 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:07.215540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:07.216481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:07.217485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:07.220044 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 341/695] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:07.221093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.294693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1d07a-b3d9-4d25-9575-76f97f4a9a4e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.334096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.335113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.335531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.335859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bed7b-d8e7-4c25-b4a4-b397caa025f2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.336137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.347289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.349508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:07.371117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:07.372242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:07.373240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:07.373240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:07.373240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:07.373240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:07.375297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 355/696] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:07.376391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.383529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.384209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.384492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.384765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.385664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:07.386028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.387518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.407419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 342/697] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:07.408328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.493405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678526-98ac-4d67-9721-855b7e533e24 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.527567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.528260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.528543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.528648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd66be-4391-45f7-956c-0db2d67faa3e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.528812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.529639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:07.529939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.531412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.548269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 356/698] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:07.549166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.565015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.566048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.566522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.567016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.568284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:07.568782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.570354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.582759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 343/699] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:07.584058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.652156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1218e3-5c26-48c8-a361-85f4d14c1ad9 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.682718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075acd0-66e2-42e5-a328-2dbecab733fe None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.686256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.686516 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.686906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.687302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.695582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.697161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:07.711783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:07.712832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:07.713830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:07.718225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 357/700] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:07.719142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.721897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.722763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.723245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.723682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.724695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=fce6f00e1a97411fa0c248a8f08b2256) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:07.725226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.726977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.733979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 344/701] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/role_assignments?user.id=fce6f00e1a97411fa0c248a8f08b2256&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:07.735056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.888487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a726c-6803-4eee-9384-58aecda40c68 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.931224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.931827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.932108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.932376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.933221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:07.937261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.938827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:07.945082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dae03-0d9c-47b4-b0b6-0125720a13bc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:07.976874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 345/702] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:07.984087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:07.988130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335efcd-f49a-4329-89f9-cefe8e2e69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:07.988970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335efcd-f49a-4329-89f9-cefe8e2e69cc None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:07.989254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335efcd-f49a-4329-89f9-cefe8e2e69cc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:07.994907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335efcd-f49a-4329-89f9-cefe8e2e69cc None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:07.994907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335efcd-f49a-4329-89f9-cefe8e2e69cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:07.994907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335efcd-f49a-4329-89f9-cefe8e2e69cc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:08.017314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 358/703] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:03:07 2022] POST /identity/v3/users => generated 254 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:08.109625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37c5c-51ac-4f84-a1e8-76878174e165 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:08.154338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:08.156821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.157129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.157399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.228746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:08.230130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:08.285458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ab43-b526-4533-86d9-90562c82462a None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.285793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ab43-b526-4533-86d9-90562c82462a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.286011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116ab43-b526-4533-86d9-90562c82462a None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.287383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 359/704] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:08.295173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.295458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.295982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.323605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:08.324791 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:08.346523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 346/705] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 08:03:08.352358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:08.415966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 360/706] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:08.447362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:08.464474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5125af-cc7e-4a6f-b762-fafaa0860ad9 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:08.520646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:08.521415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.521695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.521963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.540468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:08.541929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:08.569493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:08.570497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:08.571494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:08.571494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:08.571494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:08.571494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:08.571494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 347/707] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:08.577470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:08.632970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e7871-c1df-4cec-a2ba-1e61793b59fd None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:08.703137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:08.703958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.704229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.704490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.705138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:08.706504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:08.725985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:08.727066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:08.727953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:08.728792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 361/708] 10.222.0.59 () {56 vars in 1129 bytes} [Wed May 4 08:03:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:08.735520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:08.749780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a225555-141e-45b1-a8be-02c37552ad6c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:08.810235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:08.812919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.813437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.813909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.816022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:08.816535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:08.819124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:08.844798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 348/709] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:08.851214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:08.906107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ef4c1-2ce8-4fcc-ab25-19e9bb0d2f1a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:08.952281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:08.953057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:08.953250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:08.953485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:08.954202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:08.954489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:08.955895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:08.967344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 362/710] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 4 08:03:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:08.974500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:08.996449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68a61-6dfa-4219-8be5-88125e77ae12 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.033511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.034324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.034599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.034864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.046395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.047888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-20a73cef-e95f-4b87-a99e-49850d52a117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:09.069911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:09.070862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:09.072298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:09.073702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 349/711] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:09.075837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d95db-6537-448f-9eb5-2872f06c0fe1 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.076122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d95db-6537-448f-9eb5-2872f06c0fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.076731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d95db-6537-448f-9eb5-2872f06c0fe1 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.078135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 350/712] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:09.081226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d95db-6537-448f-9eb5-2872f06c0fe1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:09.129996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4705a-f006-4b1f-92e6-8a4085616abf None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.164541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.165672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.165672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.165899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.166403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:09.166696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.168105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d660c7e-f38b-4e9f-bc9b-83674ec1993f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.178908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 363/713] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 4 08:03:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:09.178908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.178908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.178908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.192881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:09.194080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:09.235712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d95db-6537-448f-9eb5-2872f06c0fe1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.265805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 364/714] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:09.287060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.287727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.288001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.288307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.289095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:09.289393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.290807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.307373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 351/715] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:09.309268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:09.322320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:09.463638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f933e-c892-4549-8b7c-776d9bfb6b64 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.505538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285973c-114b-42e7-b0e9-946b4833b5b4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.519862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.520527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.520803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.521073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.522072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=268f6afa0af84c6b9a6807975bb8db87) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:09.522379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.524549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.534909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 365/716] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:09 2022] GET /identity/v3/role_assignments?user.id=268f6afa0af84c6b9a6807975bb8db87&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:09.549277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.550103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.550379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.550648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.551352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.552746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:09.568100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:09.569195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:09.570060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 352/717] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:09 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:09.575587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:09.676181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bc6ef-c3cd-46c9-ad46-6390d14396c2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.723183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.723864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.724186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.724460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.725172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] RBAC: Adding query filter params (name=network) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:09.725469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.726849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd0008-c47f-47a3-9cc4-644c1fda118a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.732029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 366/718] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:09.737273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:09.843448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aeb13-d0b3-44a2-8f86-b7fbf778e6e6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:09.877060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:09.877742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:09.878002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:09.878273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:09.879017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:09.879318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:09.880693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d95f5-7a2f-41b8-a5fe-4942548c26f0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:09.887215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 353/719] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:10.711708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc031-aa22-4575-8881-dc7c519f5947 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:10.712310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc031-aa22-4575-8881-dc7c519f5947 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:10.712573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc031-aa22-4575-8881-dc7c519f5947 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:10.714278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 367/720] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:10.715875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818b457-71d1-4b44-a51c-379395dee33b None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:10.716251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818b457-71d1-4b44-a51c-379395dee33b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:10.716428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818b457-71d1-4b44-a51c-379395dee33b None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:10.718071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 354/721] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:10.722875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:10.723178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:10.723455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:10.730630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:10.730927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:10.731205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:10.747974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:10.749170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:10.756783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:10.757936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:10.840444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 355/722] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:10.869415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 368/723] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:10.879294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:10.904890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.050311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8786680-e161-4bd0-aa5b-79289e5dee37 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.080365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3de9c1-8a9f-4c0f-b004-a536b985d1dc None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.111477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.112279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.112558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.112830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.129963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:11.137715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:11.138815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:11.139760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:11.140419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 356/724] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:11.143937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.144989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.145270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.145548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.146802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.169729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:11.177657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:11.179894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:11.181736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 369/725] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:11.189228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.310402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0136c73-e696-4bbf-bfb2-b09afc5bdcd5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.365252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13f33-98df-4794-ba4c-9f356061863e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.374902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.374902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.374902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.374902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.375330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:11.375330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.375330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.380655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 357/726] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:11.388195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.452598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.453528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.453970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.454380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.455291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:11.455729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.457250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.477479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 370/727] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:11.483093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.493650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b9a2c-2a84-40b3-8ffc-c5ab2430baea None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.531564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.532625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.533081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.533515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.546024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.548072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:11.572831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:11.573970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:11.575134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:11.575134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:11.575134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:11.575134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:11.577884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 358/728] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:11.585845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.701790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e2d08-fb3e-44dc-a370-b63b6063c703 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.717075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5285e31-2247-4e2d-8c18-f64b1a1c6062 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.746253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.747175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.747462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.747733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.748564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:11.751096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.752463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.776716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 359/729] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:11.780112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.780907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.781257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.781521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.782912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.806158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.807645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-475061ed-5579-4040-ac59-88d779fa9552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:11.835366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:11.836331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:11.837282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:11.837282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:11.837282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:11.837282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:11.837282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 371/730] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:11.838156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3a47-a96c-4739-9fdb-d5f1c1768177 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.838257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3a47-a96c-4739-9fdb-d5f1c1768177 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.838506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3a47-a96c-4739-9fdb-d5f1c1768177 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.844485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 372/731] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:11.845489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3a47-a96c-4739-9fdb-d5f1c1768177 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:11.913303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b9918-cfd6-4ec9-a782-cebf126a55aa None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.946085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3a47-a96c-4739-9fdb-d5f1c1768177 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:11.948322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.949348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.949807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.950281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.961174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.962906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-91cd89de-3f9c-4b17-aa2f-7ee0a68061a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:11.978658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:11.979703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:11.980752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:11.981304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:11.981304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.981304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.981304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:11.981581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:11.981686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:11.983323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:11.988537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 360/732] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:11.989957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:11.990312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:11.990657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.000964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 373/733] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:12.002034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.007999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:12.009242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:12.082967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 361/734] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:12.083951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.102797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73549ad-bc6c-4a59-8598-b038c360d2aa None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.136871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.137836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.138270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.138795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.139884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:12.140335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.142010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.163076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 374/735] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:12.164309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.208737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b9bd4-7e06-4aa9-b8a6-4c786b0d2e1c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.243918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.244721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.245006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.245279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.252639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.254090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.263833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccb50a-8717-4ccd-b68b-57c5e2e03a88 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:12.268669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:12.269593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:12.270573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:12.274770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 362/736] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:12.275777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.301769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.302771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.303208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.303615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.304494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.306000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.326218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 375/737] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:12 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:12.327310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.405216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1dac2-99d3-4413-af72-8033ff2edd75 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.458996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beccdfe-ff5f-429f-aa63-bf6ef57f2d68 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.466364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e54ad-0825-43f1-ab55-81ae77fb66f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.467287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e54ad-0825-43f1-ab55-81ae77fb66f5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.468129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e54ad-0825-43f1-ab55-81ae77fb66f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.468405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e54ad-0825-43f1-ab55-81ae77fb66f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.495460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.496556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.497029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.497546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.498788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:12.499334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.501007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69931735-ee0c-411b-bc5d-a44d90cc1b30 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.520892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 376/738] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:12.522556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df696c-275a-4d10-adc0-a252ab4f749c None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.523036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df696c-275a-4d10-adc0-a252ab4f749c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.523496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df696c-275a-4d10-adc0-a252ab4f749c None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.525113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 377/739] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:12.526984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df696c-275a-4d10-adc0-a252ab4f749c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.553586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e54ad-0825-43f1-ab55-81ae77fb66f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.555270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e54ad-0825-43f1-ab55-81ae77fb66f5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.637626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df696c-275a-4d10-adc0-a252ab4f749c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.672427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4a04b-2984-4321-b796-cac4ed6038c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.673031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a04b-2984-4321-b796-cac4ed6038c8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.673312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a04b-2984-4321-b796-cac4ed6038c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.673633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4a04b-2984-4321-b796-cac4ed6038c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.679093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 363/740] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:03:12.680416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.680698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.680963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.708301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:12.710191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:12.751470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a04b-2984-4321-b796-cac4ed6038c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.753019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4a04b-2984-4321-b796-cac4ed6038c8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.794613 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 364/741] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:12.795711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.854575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 378/742] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 08:03:12.856301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a009575-8436-44dd-bd1a-2d4d2b77b78b None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.856589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a009575-8436-44dd-bd1a-2d4d2b77b78b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.856860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a009575-8436-44dd-bd1a-2d4d2b77b78b None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.858336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 379/743] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:12.862100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a009575-8436-44dd-bd1a-2d4d2b77b78b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.904546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166de2-6332-4dd0-becd-aaccbd8358a8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.940381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.941136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:12.941413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:12.941676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:12.951932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:12.953386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:12.965239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a009575-8436-44dd-bd1a-2d4d2b77b78b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:12.971087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:12.972133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:12.973208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:12.973208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:12.973208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:12.973208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:12.979229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 365/744] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:12.980100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:12.999056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fec48-9cd6-408a-b41a-921488b5a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:12.999861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fec48-9cd6-408a-b41a-921488b5a892 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.000139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fec48-9cd6-408a-b41a-921488b5a892 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.000413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fec48-9cd6-408a-b41a-921488b5a892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.010591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fec48-9cd6-408a-b41a-921488b5a892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-d72fec48-9cd6-408a-b41a-921488b5a892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:13.018393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:13.019467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:13.020456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 380/745] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:13.021175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.021455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.021731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.037620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:13.038869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:13.087007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1297-608e-472f-a125-de9bdf218f7e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.106592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 381/746] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 08:03:13.107568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.127582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.129024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.129872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.130382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.141103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.142547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:13.158970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:13.160014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:13.161519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:13.161519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:13.161519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:13.161519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:13.161519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 366/747] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:13.161519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.217124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444a1ac-2a49-47fa-b889-67be86796b00 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.250513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.251572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.252050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.252532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.253464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:13.253962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.255676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.260901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2b24-9733-49d0-801c-ef1a6aec0b88 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.266943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 382/748] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:13.271768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.297289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.297946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.298225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.298494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.299264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:13.299566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.300924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.309098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 367/749] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:13.309893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.367626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20300c-4623-4496-b66a-4616942d628d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.402549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.403242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.403521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.403840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.404571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.405938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.408575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6a93a-185e-4781-b8fd-3b2934bed6fd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.423102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 383/750] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:13 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:13.423102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.462161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.462852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.463191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.463510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.464253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:13.464558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.467299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.487236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 368/751] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:13.487236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.544319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca445-53dc-4457-9fe6-d112e591bb3a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.581535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.582353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.582678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.582910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.590461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.592014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.594910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093f5aa-f7a7-4cab-82b5-80ab0099ef85 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:13.607141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:13.608302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:13.609215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 384/752] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:13.609705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.634866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.635554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.635830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.636101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.648838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.650403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:13.670215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:13.671234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:13.672182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:13.672182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:13.672182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:13.672182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:13.672182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 369/753] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:13.672900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.729902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1c91-5b3c-4971-b2b4-eaf093d52c40 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.766144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.768043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.768524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.769088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.778006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.779939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:13.795621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:13.796620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:13.797616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:13.800358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 385/754] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:13.805914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.906248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769a7d-eb1e-41fc-9ca7-b54e53cbe63b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.938279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.938863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43352-49db-4753-8941-2d6334667a5e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:13.939880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.940414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.940870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.941818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:13.942628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.944277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:13.962803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 386/755] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:13.964132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:13.981220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302729df-2338-4939-8553-da402c05755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:13.981799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302729df-2338-4939-8553-da402c05755e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:13.982073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302729df-2338-4939-8553-da402c05755e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:13.982358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302729df-2338-4939-8553-da402c05755e None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:13.983174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302729df-2338-4939-8553-da402c05755e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:13.983472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302729df-2338-4939-8553-da402c05755e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:13.984879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302729df-2338-4939-8553-da402c05755e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.000101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 370/756] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:14.005185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302729df-2338-4939-8553-da402c05755e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.096725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302729df-2338-4939-8553-da402c05755e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.097671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44873121-172e-4119-a3c6-f6fb24816587 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.131052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.131686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.131961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.132225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.133002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:14.133289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.134763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.137923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.139015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.139492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.139953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.149180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.151239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.151419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 387/757] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:14.152464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:14.169742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:14.170796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:14.171804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:14.174961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 371/758] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:14.175973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.256194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb90e5-380c-43f7-8786-c8f2d13fc340 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.290567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.291282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.291599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.291792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.292917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=389b4a32ee1543f0a5111eea5e4b6b1a) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:14.293220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.294652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.300763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 388/759] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:14 2022] GET /identity/v3/role_assignments?user.id=389b4a32ee1543f0a5111eea5e4b6b1a&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:14.301619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.314090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c2b3-8f8f-4507-8ee9-96cc81c4eb61 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.407655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.408342 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.408617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.408890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.409727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=fce6f00e1a97411fa0c248a8f08b2256) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:14.409836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cecc-bcb0-4463-95a9-c87200648357 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.410034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.411582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.429303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 372/760] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:14 2022] GET /identity/v3/role_assignments?user.id=fce6f00e1a97411fa0c248a8f08b2256&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:14.462420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.463131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.463410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.463745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.464626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:14.464976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.466444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a58b71-ded0-43d4-8bee-5686b174b4ab None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.496034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 389/761] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:14.501834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.657771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce654414-52d3-4edb-8350-807ad12516bc None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.708721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.709527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.709805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.710071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.721058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.722505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:14.739664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:14.740640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:14.741589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:14.741589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:14.741589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:14.741589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:14.741589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 373/762] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:14.745800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314b18-3280-41e9-ad10-e341c0ca49dd None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.745942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314b18-3280-41e9-ad10-e341c0ca49dd None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.746164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314b18-3280-41e9-ad10-e341c0ca49dd None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.747552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 390/763] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:14.748472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.756862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.757210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.757629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.791898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:14.793074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:14.858616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 391/764] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:14.898068 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:14.898567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae345c7e-1b86-4257-9dba-d3398d1e2ca2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:14.976293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:14.976927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:14.977215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:14.977499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:14.978223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:14.978549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:14.979948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.002114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413cc50-8ec0-4e0a-bbf9-cb7779c8d2ee None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.017366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 374/765] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:15.040572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:15.154487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4e61-f731-4bcc-b5a9-60c6ea56dfab None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.193154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.193945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.194215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.194474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.198518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.199346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.199615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.199877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.200522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.201951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.209673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.211130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:15.221009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:15.222848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:15.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:15.231115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 392/766] 10.222.0.59 () {56 vars in 1129 bytes} [Wed May 4 08:03:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:15.232002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:15.236365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:15.238135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:15.240019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 375/767] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:15.243123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:15.369382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c614b-87dc-465d-a2b4-a6378bec20e1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.412214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.412884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.413156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.413421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.414211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:15.414509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.415964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.430519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 376/768] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:15.436339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:15.502930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df859e-a6cd-4b74-ac6c-459afc29c36c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.541843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce40c4-5c55-4e89-bd9e-de817696af9f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.576067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.577057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.577332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.577596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/268f6afa0af84c6b9a6807975bb8db87/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.582915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=268f6afa0af84c6b9a6807975bb8db87, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.582915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.584805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.585742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.586023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.586427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.594925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:15.594925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.594925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.594925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 393/769] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 4 08:03:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:15.599467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:15.618249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 377/770] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:15 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/268f6afa0af84c6b9a6807975bb8db87/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:03:15.735003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4bfb3-c35a-4365-b7c0-746c263f268d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.780868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.781916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.782398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.782918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.783913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:15.784420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.786219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.792090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 394/771] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 4 08:03:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:15.798316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:15.929849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa96089-98a9-4e10-8930-2e13b56beba1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:15.964556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:15.965224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:15.965496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:15.965757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:15.966561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] RBAC: Adding query filter params (interface=public, service_id=57f63cf89cd6441086f12c1cabd6a105, region_id=RegionOne) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:15.966868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:15.968283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94d71c-7294-4156-9302-f60b96080fb3 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:15.976006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 378/772] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:15 2022] GET /identity/v3/endpoints?service_id=57f63cf89cd6441086f12c1cabd6a105&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:15.981283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:16.080350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adddb47-de86-4ffd-bdc7-4b7d55d0a46f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.080844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adddb47-de86-4ffd-bdc7-4b7d55d0a46f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.080844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adddb47-de86-4ffd-bdc7-4b7d55d0a46f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.082406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 379/773] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:16.087438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.087725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.087994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.089623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14550ae-1b18-4d99-b17e-1608a96f06df None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:16.104556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:16.105710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:16.159705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:16.160376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.160645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.160905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.161590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:16.162996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:16.172316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 395/774] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:15 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:16.195744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 380/775] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:16.219271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:16.323207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cf2a5-928b-4e85-a610-e8ec61b28686 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:16.358223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:16.359060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.359337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.359602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.360252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:16.361602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:16.373912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:16.375007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:16.375870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 396/776] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:16 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:16.381450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:16.497004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7c9f7-a929-4d87-97bd-31af53ae50df None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:16.552896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:16.553946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.554445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.554939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.555864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] RBAC: Adding query filter params (name=network) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:16.556457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:16.558010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:16.563331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 381/777] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:16.570951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:16.672484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b07aa-b747-4d8e-b3d2-9b95f1d6f3d9 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:16.707458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:16.708201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.708472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.708733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.709639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] RBAC: Adding query filter params (type=network) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:16.710293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:16.712496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:16.718856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 397/778] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:16.726101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:16.853900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d19662-23a0-4521-9f20-ede1081ff142 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:16.893943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:16.895040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:16.895525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:16.895992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:16.897041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] RBAC: Adding query filter params (interface=public, service_id=b11bda473c704f91aaeea62319f176dc, region_id=RegionOne) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:16.897587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:16.899242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0cb88-96bd-4a54-ad6f-985bb34587d9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:16.905600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 382/779] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:16 2022] GET /identity/v3/endpoints?service_id=b11bda473c704f91aaeea62319f176dc&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:16.911636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.061771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39916f-f196-4f73-94ff-6f680f601f10 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:17.078260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4166d-5186-472d-9e58-18d37163ef6f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.078538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4166d-5186-472d-9e58-18d37163ef6f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.078811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4166d-5186-472d-9e58-18d37163ef6f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.080200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 383/780] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:17.092630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62db6-3014-4d3e-b916-6f2563c576c5 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.093239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62db6-3014-4d3e-b916-6f2563c576c5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.093239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62db6-3014-4d3e-b916-6f2563c576c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.114179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-46f62db6-3014-4d3e-b916-6f2563c576c5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:17.116490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-46f62db6-3014-4d3e-b916-6f2563c576c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:17.123716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8f7d-b342-4755-a310-1aea547b4810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:17.124595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8f7d-b342-4755-a310-1aea547b4810 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.125017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8f7d-b342-4755-a310-1aea547b4810 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.125427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8f7d-b342-4755-a310-1aea547b4810 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.126265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae8f7d-b342-4755-a310-1aea547b4810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:17.127787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae8f7d-b342-4755-a310-1aea547b4810 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:17.143278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 398/781] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:16 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:17.203546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 384/782] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:17.227980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae8ad-f00f-4546-a0bc-105097744a68 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.228439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae8ad-f00f-4546-a0bc-105097744a68 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.228813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aae8ad-f00f-4546-a0bc-105097744a68 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.230297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 399/783] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:17.237106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.237556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aae8ad-f00f-4546-a0bc-105097744a68 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.237822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.238268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.266239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:17.267488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:17.381476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 385/784] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:17.415831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.416354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aae8ad-f00f-4546-a0bc-105097744a68 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:17.462751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:17.463621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.463895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.464162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.475193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:17.482958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:17.483902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:17.484778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 400/785] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:17.504354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.538497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5008d78-179f-4e37-98ce-a2bb6e69ae2d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:17.584189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:17.585010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.585289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.585556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.608032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:17.610217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345aed-7711-4757-a375-1d50f871bc93 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:17.623885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:17.626029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:17.628038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 386/786] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:17.635065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.656153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:17.656854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.657129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.657441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.658189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:17.658482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:17.659871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:17.674308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 401/787] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:17.689408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.742921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8284-ee4c-42f7-9fec-8ebebce1a284 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:17.792181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:17.792892 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.793192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.793469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.794252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:17.794586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:17.796055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:17.809639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9aa79-ff16-4642-b1aa-6fa043984aa0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:17.814775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 387/788] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:17.820878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:17.848815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:17.849609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:17.849925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:17.850187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:17.868677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:17.870117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:17.902816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:17.904958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:17.907091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:17.907091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:17.907091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:17.907091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:17.907091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 402/789] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:17.910913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.019602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6725bd-de47-4a09-8686-777f58fb710c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.069037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e929-3d8b-4ae7-b5c5-c39d362bda09 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.082282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.083182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.083383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.083660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.106696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.107312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.108890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.108890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.108890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.113761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.113933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:18.113933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.113933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.120904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 403/790] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:18.130788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:18.131756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:18.132668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:18.132668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:18.132668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:18.132668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:18.132908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.144135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 388/791] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:18.147430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.261051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06f18e-7bd5-409c-b86c-f309fff6fb34 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.297629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.298292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.298564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.298830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.299587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:18.299888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.301236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.313349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 389/792] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:18.319348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.332041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293f32a-331c-46f8-8c8a-d6e9842b4d93 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.373767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.375159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.377147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.377651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.394362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.396347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:18.421182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:18.422410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:18.423528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:18.429072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 404/793] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:18.431033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.523873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a182-c014-4f32-8593-4744b959204a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.573149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.574275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.574733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.575229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.582809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.584497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.587970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa4b3-fcac-4b23-85de-ce0e81ae3cdc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-71781d53-ed9c-4cac-8239-0463a4b80210 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:18.599887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:18.600885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:18.601878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:18.609097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 390/794] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:18.610649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a3a5-a2ca-4ef6-a14a-755195bcd200 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.611139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a3a5-a2ca-4ef6-a14a-755195bcd200 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.611588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a3a5-a2ca-4ef6-a14a-755195bcd200 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.613086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 391/795] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:18.614580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a3a5-a2ca-4ef6-a14a-755195bcd200 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.629685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.630806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.631665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.632279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.633366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:18.633970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.635869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dedaf-6d6d-43bd-b633-57aa3e668a04 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.662386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 405/796] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:18.662386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.662386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.662386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.686362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:18.687946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:18.723155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a3a5-a2ca-4ef6-a14a-755195bcd200 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.760445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.761916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.762654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.763160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.764319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:18.764930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.766477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 406/797] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:18.766938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.773617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.793336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 392/798] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:18.795039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.893057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed0a07-33fd-4531-bd8d-d7fe35cb30cd None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.927290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.928191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.928413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.928686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.932159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a74d58-ad53-4649-8e60-7d1ded528eda None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:18.938923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.940442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:18.958054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:18.959013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:18.960062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:18.960062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:18.960062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:18.960062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:18.963975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 407/799] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:18.964814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:18.974930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:18.976383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:18.977173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:18.977943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:18.991651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:18.994415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:19.019027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:19.020084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:19.021014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:19.021014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:19.021014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:19.021014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:19.028655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 393/800] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:19.030246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.074486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f9d2-db3d-4239-b726-cc20855f00a2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.108607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.109431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.109710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.110016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.120335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:19.128164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:19.129390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:19.130261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:19.134568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 408/801] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:19.135445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.158842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f88ac9-500b-4058-9bb1-0c766c5b30a0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.200919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.201588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.201869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.202140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.202870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:19.203197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.204569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.220436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 394/802] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:19.220436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.238771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aa19b-70bb-46e2-ab58-ae05d8c4cea5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.272360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.273019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.273291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.273640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.274269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:19.274566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.276022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c0f6-2b9e-40e8-afb8-c6f87a73f584 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.288530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 409/803] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:19.289820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef173-a8cb-47fa-9efa-219f89d1c6b3 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.290180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef173-a8cb-47fa-9efa-219f89d1c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.290382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef173-a8cb-47fa-9efa-219f89d1c6b3 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.293856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 410/804] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:19.295577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eef173-a8cb-47fa-9efa-219f89d1c6b3 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.316152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0345c-385d-4fd0-9783-ba8a76006aea None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.350091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.350698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.350991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.351260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.352003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:19.352314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.353658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.366016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 395/805] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:19.366016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.403260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eef173-a8cb-47fa-9efa-219f89d1c6b3 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.439585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.440395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.440670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.440944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.450441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.452631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.464480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21714815-def1-44a5-8849-47b62acb2002 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-2ac1fc16-d35b-4b11-a00a-4e5f7f3de60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:19.468169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:19.469175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:19.470112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:19.474509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 411/806] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:19.475754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.476046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.476322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.493014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:19.494187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:19.499338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.500193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.500472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.500733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.507453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.508905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:19.522861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:19.524077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 396/807] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:19.525405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.574904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 412/808] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:19.574904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.641833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb093-a070-4781-81e6-e8fe85a745d6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.660729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88592875-e7c8-4e8e-b40e-f37a636aabd3 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.676071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.676862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.677136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.677400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.686924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.688350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.694160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.694815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.695122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.695388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.696169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:19.696453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.697877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:19.705855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:19.706815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:19.707808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:19.707808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:19.707808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:19.707808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:19.707808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 397/809] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:19.707808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.713253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 413/810] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:19.714062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.801907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd55c46-e0b9-4ff0-bce0-1e44a71bc8e2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.811602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4b190-d168-407f-b780-32642451fd90 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.835654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.836307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.836588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.836857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.837638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:19.837947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.839407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476ef1b-9af2-4569-a341-12bd3c2b2ec5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.844861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.845657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.845932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.846204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.846853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.848250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.850625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 398/811] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:19.852020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec900-923b-4ce0-a7f0-17d55542714a None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.852303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec900-923b-4ce0-a7f0-17d55542714a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.852577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec900-923b-4ce0-a7f0-17d55542714a None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.853784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 399/812] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:19.854464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec900-923b-4ce0-a7f0-17d55542714a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:19.864470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:19.865637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:19.866513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 414/813] 10.222.0.59 () {56 vars in 1129 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:19.867505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:19.954002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec900-923b-4ce0-a7f0-17d55542714a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.957689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5ae8c-4af8-4b3c-832d-7b9a3b08af76 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:19.986578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.987262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.987542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.987810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.988525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:19.988829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.990072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bbf48-3e10-4459-8304-0897811cefd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:19.990185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:19.990983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bbf48-3e10-4459-8304-0897811cefd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:19.991275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bbf48-3e10-4459-8304-0897811cefd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:19.991487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bbf48-3e10-4459-8304-0897811cefd9 None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/fce6f00e1a97411fa0c248a8f08b2256/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:19.993513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bbf48-3e10-4459-8304-0897811cefd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=fce6f00e1a97411fa0c248a8f08b2256, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:19.994935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bbf48-3e10-4459-8304-0897811cefd9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.001987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 400/814] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:20.002838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.013312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 415/815] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:19 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/fce6f00e1a97411fa0c248a8f08b2256/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:03:20.014544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.014822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.015174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.032973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:20.034184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:20.105813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72168-e91f-4c7a-bb41-4eb6f3f89fa5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.115317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 416/816] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:20.115317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.141637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.142540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.142823 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.143131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/389b4a32ee1543f0a5111eea5e4b6b1a/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.158822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=389b4a32ee1543f0a5111eea5e4b6b1a, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.160311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.174042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 401/817] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:20 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/389b4a32ee1543f0a5111eea5e4b6b1a/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:03:20.176033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.242373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dd415-5a6b-40c4-825b-92b1a5240ad8 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.292737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.294113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.294600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.295310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.296238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:20.296883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.298767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.305754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 417/818] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:20.307183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.315373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2c06-3fb9-4a2a-b452-fa1f5efd3fd1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.370588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.371565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.371952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.372420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.380518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.382716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:20.400105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:20.401143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:20.402150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 402/819] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:20.402852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.435865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55647595-1c69-4e57-a37e-fc6cc5bf1c73 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.485775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.487134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.487677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.488504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] PATH_INFO: `/v3/services/network` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.489663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.491792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:20.506542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:20.507616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:20.508492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 418/820] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:20.509313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.517210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd059-ba51-4515-80d8-76718031c9db None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.551102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.551759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.552031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.552296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.552993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:20.553287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.554639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.560545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 403/821] 10.222.0.59 () {56 vars in 1124 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:20.561344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.639750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6955aa-a795-45ba-b969-9dd03156a028 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.665365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6916d-7120-47e5-bd77-2fcf8df9007a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.681826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.683164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.683668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.684166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.685290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:20.686264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.688186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.700429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.700893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.701167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.701433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.702177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:20.702481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.703903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.713352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 404/822] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:20.713352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.718919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 419/823] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:20.719068 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.820603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d699f0-aeb6-4ee8-b938-983f51e1d8f0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.825440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7b90-8eae-42fc-8f9a-d8787a650a70 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:20.853928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.854585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.854856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.855142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.855918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.857234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.862097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:20.863067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:20.863583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:20.864050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:20.864951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] RBAC: Adding query filter params (type=network) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:20.865478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:20.867076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:20.879085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 420/824] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:20.879085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:20.886921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 405/825] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:20.886921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:21.003745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fb589-56fd-40b4-a210-c1f559d6f75e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:21.007178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95debf-1827-4101-8a50-36b0ef33d632 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:21.040125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:21.041041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:21.041465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:21.041611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:21.042048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:21.042278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:21.042551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:21.042816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:21.043701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:21.045236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:21.080166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 406/826] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:21.122036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:21.124422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:21.233422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 421/827] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:21.238905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:21.382511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7672546-e3b3-4629-b9f4-106f44092fd7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:21.425804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:21.426607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:21.426907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:21.427189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:21.437825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:21.439304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:21.456577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:21.457567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:21.459083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:21.459083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:21.459083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:21.459083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:21.459083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 407/828] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:21.463576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:21.575661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369b0f2-eb03-4f15-9123-a25a3982d93b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:21.611134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:21.611808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:21.612085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:21.612382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:21.613108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:21.613426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:21.614833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:21.626687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 422/829] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:21.632393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:21.733650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cbb9b-c7d4-4b06-9704-442b767cec76 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:21.767470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:21.768551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:21.768831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:21.769158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:21.776370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:21.777821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:21.792101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:21.793031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:21.794409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 408/830] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:21.799301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:21.898528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1c1eb-e232-4845-97e1-27a841d5bab5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:21.931620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:21.932282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:21.932561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:21.932836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:21.933619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:21.933922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:21.935420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4897-b70e-4dd8-811a-d0459522ed37 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:21.948322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 423/831] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:21.954244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:22.053896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5a17-3731-4c9a-8336-346a144c17db None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:22.090912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:22.090912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.090912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.090912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.091742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=268f6afa0af84c6b9a6807975bb8db87) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:22.091742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:22.092297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928af80-5b3f-4b2f-b803-c92034606e83 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:22.098687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 409/832] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:21 2022] GET /identity/v3/role_assignments?user.id=268f6afa0af84c6b9a6807975bb8db87&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:22.440978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781692-5326-4a50-b81e-64acbaee52c3 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.441646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781692-5326-4a50-b81e-64acbaee52c3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.441646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f781692-5326-4a50-b81e-64acbaee52c3 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.444722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 424/833] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:22.450344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55874-c2ba-4a0d-9af6-9c821463a944 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.451060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55874-c2ba-4a0d-9af6-9c821463a944 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.451060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55874-c2ba-4a0d-9af6-9c821463a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.468837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-39a55874-c2ba-4a0d-9af6-9c821463a944 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:22.470038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-39a55874-c2ba-4a0d-9af6-9c821463a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:22.542658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 410/834] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:22.565283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f781692-5326-4a50-b81e-64acbaee52c3 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:22.650707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa9044-7219-4e29-843e-2fb664412520 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.651421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa9044-7219-4e29-843e-2fb664412520 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.651906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa9044-7219-4e29-843e-2fb664412520 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.654802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 411/835] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:22.659028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.659781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.660289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.669449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f781692-5326-4a50-b81e-64acbaee52c3 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:22.683403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:22.685703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:22.707971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:22.709447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.709928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.710433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.724240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:22.734170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:22.735173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:22.736054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:22.737560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 425/836] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:22.742077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:22.774914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 412/837] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:22.797002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:22.853349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a3859-7d7f-4764-bf29-895c3191a739 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:22.896894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:22.897684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.897863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.898082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.898818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:22.899139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:22.900563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:22.911524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ebce3-8907-460e-84ee-e4d09970ebfa None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:22.913372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 426/838] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:22.914271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:22.949369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:22.950541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:22.951082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:22.951564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:22.962128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:22.971833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:22.972810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:03:22.973663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:22.980874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 413/839] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:03:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:22.982432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.016966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e411b7-db93-4610-b59c-18650b9c5ebb None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.052807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.053020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.053309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.053577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.064456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.065909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:23.083919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:23.084874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:23.085803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:23.085803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:23.085803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:23.085803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:23.087309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe2d30-474a-4ca7-ad4e-a09836ef994d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.089893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 427/840] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:23.090751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.122303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.123404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.123877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.124352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.125275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:23.125785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.127355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.140114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 414/841] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:03:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:23.141661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.188763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faf3fa-34fa-4360-bbd1-4377e1d74139 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.221768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.222528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.222742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.223058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.224145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:23.224707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.226077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.241091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4ab67-ab16-4e03-8c29-8cdd4e559cce None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.242809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 428/842] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:23.243776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.278675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.279925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.280410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.280867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.292713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.294653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:23.313322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:23.314321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:23.315291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:23.315291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:23.315291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:23.315291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:23.321747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 415/843] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:23.323213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.348056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a6a35-7898-41d3-8221-a8139c422353 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.385649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.385649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.385649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.385649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.393346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.394838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:23.409690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:23.410862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 08:03:23.412073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:23.417406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 429/844] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:23.418367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.437541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33907a-1c06-439b-b61b-604e8f900039 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.470777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.471401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.471666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.471934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.472645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:23.472945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.474291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611195c-f3e3-41a1-ab57-6ac2fdbb5b94 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.486659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 416/845] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:23.487911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f708a-7751-465c-b4d7-baa420066382 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.488194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f708a-7751-465c-b4d7-baa420066382 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.488463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f708a-7751-465c-b4d7-baa420066382 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.493674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 417/846] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:23.494447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f708a-7751-465c-b4d7-baa420066382 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.520277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3d5c-a5ac-436d-9bf3-ce0076727141 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.554708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.555409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.555672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.555938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.556769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:23.557074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.558498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b7f6a-ee9b-44cf-aad9-983fb793da1e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.580054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 430/847] 10.222.0.59 () {56 vars in 1135 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:23.580054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.580054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.580054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.593104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:23.594278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:23.597646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f708a-7751-465c-b4d7-baa420066382 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.629679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.630492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.630765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.631060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.637927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.639434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:23.654182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:23.655258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:23.656370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:23.660054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 418/848] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:23.660662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 431/849] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:23.660883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.661817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.765763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd5dbe-6d35-4c5a-8e0c-653372fae2cb None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.765960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184764bb-24a8-4520-96cb-1897308454cc None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.800260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.800638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.800938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.801217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.801312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.801488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.801581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.801785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.802322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:23.802623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.804086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.826082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 432/850] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:23.826082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.874189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.875666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.929454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fae64-46a0-4dc1-a988-ea8c647f4c0d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:23.962170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:23.962995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:23.963272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:23.963538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:23.964209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:23.965555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:23.974232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 419/851] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:23.975349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:23.977231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:23.978323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:23.979750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:23.983136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 433/852] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:23.983969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.080690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724c80c-8d5b-468f-bd76-d186548fc685 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.083895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c4784-114e-4f29-a9ac-fd2e7c112057 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.123048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.123810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.123988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.124224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.134138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.134975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.135259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.135529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.152311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.153816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:24.177771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:24.178739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:24.180307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:24.180307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:24.180307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:24.180307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:24.180307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 434/853] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:24.180307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.195472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.196917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.293143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0a18-251a-470b-b664-e8bab013c128 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.298126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 420/854] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:24.300208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.332558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.333140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.333412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.333680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.334382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:24.334680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.336074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.341096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 435/855] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:24.342301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.417716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469d329-13f4-4049-9e19-84bd0425474a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.450521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.451245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.451527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.451798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.452513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:24.452814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.454183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.459259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994f69f-09de-476b-a9bc-60246096308b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.467360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 421/856] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:24.468152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.495935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.496722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.496997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.497261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.507143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.508572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-dfb04616-a1c3-4900-b6af-bdcdb0e69b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:24.524948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:24.526269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:24.527224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:24.527224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:24.527224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:24.527224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:24.527224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 436/857] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:24.527508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046db8d-bfda-4cb0-8e4b-06706e34bc30 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.527576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046db8d-bfda-4cb0-8e4b-06706e34bc30 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.527852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046db8d-bfda-4cb0-8e4b-06706e34bc30 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.529582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 437/858] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:24.530221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046db8d-bfda-4cb0-8e4b-06706e34bc30 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.568670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b2870-f1cd-4709-86bb-92d52ce6abf5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.600061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.600662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.600941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.601207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.601905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:24.602203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.603591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.608074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 422/859] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:24.608676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.635380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046db8d-bfda-4cb0-8e4b-06706e34bc30 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.673533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.674347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.674619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.674902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.683118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.684619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-ddb9ed97-8c43-4821-80d1-2e2b3ea51c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:24.699971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:24.701096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:24.702018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 438/860] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:24.703010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.703010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.703184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.717974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d32d8-a982-499a-a4fb-d2e5ac1383ec None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.720095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:24.721288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:24.753177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.753851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.754129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.754428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.755146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:24.755452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.756846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.774165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 423/861] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:24.774165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.802902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 439/862] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:24.802902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.878918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cc676-fb58-4b82-9f7b-909fa88f0807 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.898582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcf6f2-fb1a-4560-9078-599b594fca0c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:24.911238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.911901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.912178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.912493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.913267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:24.913614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.915102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.932465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 424/863] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:24.932465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:24.933431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:24.934299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:24.934645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:24.935057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:24.941901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:24.943728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:24.957512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:24.958628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 440/864] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:24.959840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:25.035272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c35a-69cf-44cb-a88d-dbb203fb358a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:25.056231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f25d2-9330-4484-b60e-0a8049d61b28 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:25.069374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:25.070189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:25.070469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:25.070739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:25.071420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:25.072796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:25.084862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:25.085838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:25.086709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 425/865] 10.222.0.59 () {56 vars in 1132 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:25.088208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:25.092949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:25.093605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:25.093882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:25.094152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:25.095015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=fce6f00e1a97411fa0c248a8f08b2256) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:25.095321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:25.096746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:25.111193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 441/866] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:24 2022] GET /identity/v3/role_assignments?user.id=fce6f00e1a97411fa0c248a8f08b2256&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:25.111193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:25.199223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64f0ad-878d-43a3-aa4c-34a1021d4b30 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:25.206461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275e098-0d68-4571-aae2-c96152b51f7f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:25.232960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:25.233888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:25.234312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:25.234793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:25.235776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:25.236228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:25.237822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:25.245530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:25.247090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:25.247593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:25.248028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:25.249368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:25.249825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:25.251728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:25.252744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 426/867] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:25.257323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 442/868] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:25.262734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:25.263974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:25.367740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191231e-2ba5-4044-911f-06c72aa4b939 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:25.368642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47fec9-3da5-48cf-941d-9b0ec1bf0eb1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:25.409386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:25.410238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:25.410619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:25.411016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:25.412643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:25.412770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:25.412985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:25.413686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:25.414098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:25.414384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b3ea-8821-4793-b678-3d01088e9e34 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:25.414510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:25.415684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=389b4a32ee1543f0a5111eea5e4b6b1a) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:25.415684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:25.417064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a39a7-122c-48b1-84be-d51ad8e7e90e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:25.420045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 427/869] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:25.431297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 443/870] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:25 2022] GET /identity/v3/role_assignments?user.id=389b4a32ee1543f0a5111eea5e4b6b1a&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:26.868782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4152b-a78b-4322-8e02-aec692b1bfd3 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:26.869293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4152b-a78b-4322-8e02-aec692b1bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:26.869371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4152b-a78b-4322-8e02-aec692b1bfd3 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:26.871035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 428/871] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:26.876336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30770dfb-12b6-4d45-8488-61e3d8b9dd1a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:26.876993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30770dfb-12b6-4d45-8488-61e3d8b9dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:26.876993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30770dfb-12b6-4d45-8488-61e3d8b9dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:26.894275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-30770dfb-12b6-4d45-8488-61e3d8b9dd1a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:26.895487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-30770dfb-12b6-4d45-8488-61e3d8b9dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:26.962600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 444/872] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:26.985725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4152b-a78b-4322-8e02-aec692b1bfd3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:27.086612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4152b-a78b-4322-8e02-aec692b1bfd3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:27.119815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f412e-4981-4297-bf94-4413bc3bacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:27.120403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f412e-4981-4297-bf94-4413bc3bacd2 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.120682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f412e-4981-4297-bf94-4413bc3bacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.120952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f412e-4981-4297-bf94-4413bc3bacd2 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.121688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f412e-4981-4297-bf94-4413bc3bacd2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:27.123128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f412e-4981-4297-bf94-4413bc3bacd2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:27.143163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 429/873] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:26 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:27.476323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde45ef-e0df-4159-890c-d2fab5cccc8c None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.476947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde45ef-e0df-4159-890c-d2fab5cccc8c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.477432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde45ef-e0df-4159-890c-d2fab5cccc8c None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.479279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 445/874] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:27.484960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769fb05-e91e-411f-af1e-e4f945328ead None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.485679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769fb05-e91e-411f-af1e-e4f945328ead None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.486165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769fb05-e91e-411f-af1e-e4f945328ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.504888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5769fb05-e91e-411f-af1e-e4f945328ead None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:27.506111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5769fb05-e91e-411f-af1e-e4f945328ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:27.582265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 430/875] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:27.605201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde45ef-e0df-4159-890c-d2fab5cccc8c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:27.689158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb794c-5f88-44ca-ac84-26b9896403cb None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.689485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb794c-5f88-44ca-ac84-26b9896403cb None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.689647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb794c-5f88-44ca-ac84-26b9896403cb None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.691257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 431/876] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:27.696432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07692d-fee1-457e-aaa0-afc74fcab469 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.696716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07692d-fee1-457e-aaa0-afc74fcab469 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.696990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07692d-fee1-457e-aaa0-afc74fcab469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.707559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde45ef-e0df-4159-890c-d2fab5cccc8c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:27.713607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-bb07692d-fee1-457e-aaa0-afc74fcab469 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:27.714769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bb07692d-fee1-457e-aaa0-afc74fcab469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:27.749093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:27.749904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.750182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.750451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.751148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:27.752581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:27.767903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:27.768965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:27.771378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 446/877] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:27.779765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:27.783833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 432/878] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:27.785484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08ab2-d666-4a9a-b78e-0080f2c49ecf None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.785837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08ab2-d666-4a9a-b78e-0080f2c49ecf None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.786182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d08ab2-d666-4a9a-b78e-0080f2c49ecf None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.787689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 433/879] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:27.795014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.795014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.795014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.816540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:27.818080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:27.882211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 434/880] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:27.883861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:27.887596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571bde8-6f91-4883-9b74-5c1142737e48 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:27.920544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:27.930528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:27.930528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:27.930528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:27.930528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:27.930528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:27.930528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:27.933689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 447/881] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:27.934475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:27.987820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037687e1-b0d4-44dd-9936-b5cafd772df9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.021728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.022508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.022787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.023084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.023806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.025166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.037643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ffb5b-41a5-4625-a707-452f506e7847 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.039132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 435/882] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:27 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:28.039780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:28.092539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.093397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.093671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.093945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.106202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:28.114697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:28.115879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:28.116826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 448/883] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 4 08:03:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:28.124300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:28.160366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48a77d-4e3c-44b3-88a1-e0b29e8c6653 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.197308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.198158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.198406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.198680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.199451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:28.199754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.201178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.206585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 436/884] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:28.260454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d482ae-951f-4159-9f14-9603a831d017 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.300438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.301426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.301873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.302304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.303275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:28.303763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.305348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.315765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 449/885] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:28.322240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:28.430122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c309861-3b01-4dc7-a69b-ca4f7ed6c38d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.464422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.465242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.465520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.465788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.476474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.477921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:28.497117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:28.498246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:28.499379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:28.499379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:28.499379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:28.499379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:28.499379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 437/886] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:28.504471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:28.605538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ed9e5-b5fc-421d-a63d-a3848915de0e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.638418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.639137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.639441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.639717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.640438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:28.640764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.642142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.654064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 450/887] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:28.659773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:28.761296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1e314-d480-4f1d-8684-fbaff4616e30 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.798149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.799018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.799302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.799576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.808087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.810701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:28.825853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:28.828060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:28.830295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 438/888] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:28.835083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:28.935517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49bddb-4d2d-4758-8fb4-91e530a5d61b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:28.969786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:28.970531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:28.970817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:28.971114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:28.971979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:28.972285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:28.973720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:28.992512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 451/889] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:28.998271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.098906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509c59d-b967-438a-9a02-1e47edfe4523 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.132840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.133499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.133779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.134051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.201961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.203381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.313083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 439/890] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:29.319133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.421779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ff2d3-9790-43d4-a924-67ef7c90ab9a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.455886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.456674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.456952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.457277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.467485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.468938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-8437b0ce-0756-4042-b587-5720933396f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:29.486987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:29.487924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:29.489250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:29.489250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:29.489250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:29.489250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:29.489250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 452/891] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:29.494090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.499053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60bad0-47e4-4f1d-8bfc-5c8f97704877 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.499560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60bad0-47e4-4f1d-8bfc-5c8f97704877 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.500063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60bad0-47e4-4f1d-8bfc-5c8f97704877 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.501631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 453/892] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:29.506756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.507248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.507713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.525007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:29.526409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:29.590547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad924b5-2848-498a-a113-f5fbd4bc807a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.599138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 454/893] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:29.617574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.625386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.626127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.626468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.626801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.627628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:29.628147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.629657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.641486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 440/894] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:29.647956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.722933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026123-19f3-403b-9e44-550b5c1f74d2 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.748744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c9a84-7e2e-4a71-bdab-d1b935964a55 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.756894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.757885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.758297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.758697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.759560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.761076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:29.773111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:29.774210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:29.775099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:29.782714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 455/895] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:29.784226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.786246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.787462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.787660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.787885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.795013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.797008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:29.811404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:29.813585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:29.815229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:29.817827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 441/896] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:29.818859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.897681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561d77d-57d4-4654-9da6-edfb79f45c2c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.925415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ea4e-b5ac-4588-8afc-6a054bc642db None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:29.932920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.933876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.934416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.934942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.935863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:29.936797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.938368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.948607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 456/897] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:29.950042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:29.960837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:29.961664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:29.961782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:29.962044 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:29.962834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:29.963163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:29.964616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:29.981785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 442/898] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:29.982935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.054845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd06d5-d30c-480b-afc2-286ddd78183e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.082015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92070e8-d265-4635-ba07-12079d820773 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.089303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.090251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.090788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.091303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.092203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:30.092692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.094306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.104557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 457/899] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:30.106171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.117727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.118393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.118676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.119004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.120461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] RBAC: Adding query filter params (role.id=23e0684d61054741b4ebf0e309411f54, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=389b4a32ee1543f0a5111eea5e4b6b1a) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:30.120989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.123286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.135089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 443/900] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:29 2022] GET /identity/v3/role_assignments?user.id=389b4a32ee1543f0a5111eea5e4b6b1a&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=23e0684d61054741b4ebf0e309411f54 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:30.219009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c042e3-2e2e-4bd9-ace7-565c63a7e7f1 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.258422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.260119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.260931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.261656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.262775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] RBAC: Adding query filter params (interface=public, service_id=eb9d3de0ebd44d348922f017f1a57bb9, region_id=RegionOne) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:30.263427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.265177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6be32-7c05-4981-8d8b-466db8bb9ee4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.279126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 458/901] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:30 2022] GET /identity/v3/endpoints?service_id=eb9d3de0ebd44d348922f017f1a57bb9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:30.282904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.385163 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513b18a-cb71-4865-9104-2f5d3c65628d None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.385163 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513b18a-cb71-4865-9104-2f5d3c65628d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.385163 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513b18a-cb71-4865-9104-2f5d3c65628d None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.385685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 459/902] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:30.392786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.392786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.392786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.396622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981ff3e-b719-468e-b3ee-f4ecc56f65a8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.412367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:30.414020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:30.439574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5feb9-e591-474a-93eb-2cbe3b6d8bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.440964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5feb9-e591-474a-93eb-2cbe3b6d8bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.441689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5feb9-e591-474a-93eb-2cbe3b6d8bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.442453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5feb9-e591-474a-93eb-2cbe3b6d8bd1 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.443493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5feb9-e591-474a-93eb-2cbe3b6d8bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.445629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5feb9-e591-474a-93eb-2cbe3b6d8bd1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.459135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 444/903] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:30 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:03:30.462001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce4ab-b094-435d-9fca-0528edf7af4f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.462289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce4ab-b094-435d-9fca-0528edf7af4f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.462568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce4ab-b094-435d-9fca-0528edf7af4f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.464302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 445/904] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:30.472622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.473059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.473437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.491180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:30.492583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:30.498224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 460/905] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:30.522215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.578979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 446/906] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:30.597861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.633092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c0e0a-59ee-4ef5-b466-148c8ae5a8f6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.671476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.672363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.672646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.672919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.673585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.674980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:30.689232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:30.690237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:30.691141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 461/907] 10.222.0.59 () {56 vars in 1132 bytes} [Wed May 4 08:03:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:30.697504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.706661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ccf45-5eec-4190-8395-1b9d9a40bc12 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.746041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.746718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.747083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.747410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.748510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.750532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.770037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 447/908] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:30 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:03:30.814689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1831b-495d-44a7-8cf2-50b94dc2623e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:30.859304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:30.859979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:30.860254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:30.860520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:30.861226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:30.861524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:30.862962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:30.868885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 462/909] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:30.874767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:30.986446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06241fa6-fca1-4f92-9a16-7dbbc5c403c4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:31.019466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:31.020134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:31.020413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:31.020724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:31.021436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:31.021739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:31.023180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:31.028762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 448/910] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:31.034274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:31.131697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419bb9-9b01-4a23-9850-9c08f586eb12 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:31.164755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:31.165418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:31.165695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:31.165967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:31.166753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] RBAC: Adding query filter params (interface=public, service_id=49b9b1b2318248fbb5a61673f20abd02, region_id=RegionOne) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:31.167085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:31.168459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7616fb-131c-497c-b8a2-7bd29bfe0315 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:31.173868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 463/911] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:31 2022] GET /identity/v3/endpoints?service_id=49b9b1b2318248fbb5a61673f20abd02&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:31.179333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:31.278330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91eb9-dda5-436e-afb5-9567bd23d110 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:31.313163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a60fa-9971-443f-9fe4-7ad5b31b49a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:31.314216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a60fa-9971-443f-9fe4-7ad5b31b49a9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:31.314719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a60fa-9971-443f-9fe4-7ad5b31b49a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:31.315221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a60fa-9971-443f-9fe4-7ad5b31b49a9 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:31.316102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a60fa-9971-443f-9fe4-7ad5b31b49a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:31.318001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a60fa-9971-443f-9fe4-7ad5b31b49a9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:31.324521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 449/912] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:31 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:03:32.397875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f752a9-1f5c-4589-b6fe-e1f3bf2d2faf None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.398500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f752a9-1f5c-4589-b6fe-e1f3bf2d2faf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:32.398500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f752a9-1f5c-4589-b6fe-e1f3bf2d2faf None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:32.400096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 464/913] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:32.410787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.411243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:32.411422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:32.427978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:32.429131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:32.503008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 450/914] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:32.518210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f752a9-1f5c-4589-b6fe-e1f3bf2d2faf None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:32.617292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f752a9-1f5c-4589-b6fe-e1f3bf2d2faf None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:32.654139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c19a57-5158-4ebf-8250-676dd0c73eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:32.655317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19a57-5158-4ebf-8250-676dd0c73eca None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.655794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19a57-5158-4ebf-8250-676dd0c73eca None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:32.656252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19a57-5158-4ebf-8250-676dd0c73eca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:32.668252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c19a57-5158-4ebf-8250-676dd0c73eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c5c19a57-5158-4ebf-8250-676dd0c73eca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:32.676709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:32.677742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:32.678661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:32.685127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 465/915] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 4 08:03:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:32.687551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:32.786329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11073356-a7ae-426d-b339-f47be4e3d1c3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:32.820139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:32.820810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.821087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:32.821357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:32.822105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:32.822409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:32.823801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:32.825886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4fc6-9620-4898-b32e-7a500e199a9a None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.826336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4fc6-9620-4898-b32e-7a500e199a9a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:32.826815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4fc6-9620-4898-b32e-7a500e199a9a None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:32.828659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 466/916] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:32.832709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 451/917] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:03:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:32.834469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.834759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:32.835072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:32.838024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:32.853986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:32.855552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:32.929424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 467/918] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:32.956168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:32.958424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce786f95-ad14-4a2c-847e-a6dee795d31d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:32.998760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:32.999616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:32.999896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.000169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.015187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.016964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:33.039040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:33.040025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:33.040976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:33.040976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:33.040976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:33.040976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:33.042966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 452/919] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:33.047739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.073645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0b8e2-715e-42b9-9def-3b3022fbeff8 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.115688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.117731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.118221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.118678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.119558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.121137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:33.136862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:33.138062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 08:03:33.138953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:33.140550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 468/920] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:33.146207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.154119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35852d1-bccc-4bf9-92e3-9bdf508536d4 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.189221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.189890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.190167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.190430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.191173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:33.191467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.193131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119b74-bdc7-4868-aae5-3e655d6dc7a1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.204741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 453/921] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:33.206266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b7bdd-7384-48ea-bb8c-ada2149956a3 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.206748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b7bdd-7384-48ea-bb8c-ada2149956a3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.207236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b7bdd-7384-48ea-bb8c-ada2149956a3 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.208636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 454/922] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:33.212803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b7bdd-7384-48ea-bb8c-ada2149956a3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.249484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ffd8-c89c-477b-9738-fc17f5836537 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.282677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.283379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.283658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.283927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.284632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:33.284925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.286290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa9930-c07b-41b4-84ad-c339e9dcfa4d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.295663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 469/923] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:33.295663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.295663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.295663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.317366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:33.319007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:33.322097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b7bdd-7384-48ea-bb8c-ada2149956a3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.356258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.357101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.357377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.357646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.365229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.366687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:33.382337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:33.383489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:33.384482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:33.388436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 455/924] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:33.389300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 470/925] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:33.389411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.390456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.494093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd733e3-7a1f-41e9-89b4-cda47057a1c7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.501588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f13c-62bd-4e44-b5f0-00d87318d43b None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.526430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.527128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.527401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.527669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.528593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:33.528892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.530304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.534699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.535407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.535690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.535965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.536674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:33.536980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.538329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.547520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 456/926] 10.222.0.59 () {56 vars in 1114 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:33.547520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.552404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 471/927] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:33.557079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.649370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29df0a5-bcc8-454e-9440-0d6a74124b87 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.658598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ae406-23a3-4052-8f16-9ed9a3dca297 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.681742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.682553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.682829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.683131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.683775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.685135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.692742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4139-8e54-4e68-a5ca-889b32a6b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.693398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4139-8e54-4e68-a5ca-889b32a6b915 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.693677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4139-8e54-4e68-a5ca-889b32a6b915 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.693949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4139-8e54-4e68-a5ca-889b32a6b915 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.694707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c4139-8e54-4e68-a5ca-889b32a6b915 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.696098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c4139-8e54-4e68-a5ca-889b32a6b915 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:33.697645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:33.698634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:33.699531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 457/928] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:33.701146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.726058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 472/929] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:33.726058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df55b-c622-43fc-bb27-fb89f54aad27 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.726058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df55b-c622-43fc-bb27-fb89f54aad27 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.726058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df55b-c622-43fc-bb27-fb89f54aad27 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.726058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 473/930] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:33.726058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df55b-c622-43fc-bb27-fb89f54aad27 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.818964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1190d-1d3b-49d3-a49c-9763ab2575ac None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.835479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df55b-c622-43fc-bb27-fb89f54aad27 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:33.853816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.854633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.854929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.855196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.866728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.868228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.870102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:33.870786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.871130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.871400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.872136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:33.872442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:33.873817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235386e-7023-44fd-8110-1b1db44cfd93 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:33.884469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 474/931] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:33.884469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:33.884469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:33.884469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:33.886554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:33.887519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:33.888516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:33.888516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:33.888516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:33.888516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:33.888516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 458/932] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:33.895957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:33.907800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:33.908972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:33.976755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 475/933] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:33.977975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.002730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befd6e4-f27a-48ef-a0c8-a56ee5b31772 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.035196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.036013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.036381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.036745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.037535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:34.037925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.039392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.049150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 459/934] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:34.049150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.078678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06fb3c-3a30-42f6-a1a6-0a87ae37536d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.110816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.111519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.111797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.112066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.112785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:34.113080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.114479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.130228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 476/935] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:34.130228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.149668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c89d-53f2-4652-a764-35b0a7ef3e11 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.181709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.182504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.182784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.183083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.183723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.185137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:34.197375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:34.198380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 08:03:34.199296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:34.203337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 460/936] 10.222.0.59 () {56 vars in 1132 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:34.204324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.230366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7f610-e844-4693-8c26-cc0c47c58d3a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.262173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.263078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.263354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.263678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.264460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] RBAC: Adding query filter params (interface=public, service_id=2f69fe6221634384b2def7860624fd52, region_id=RegionOne) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:34.264764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.266126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.275303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 477/937] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/endpoints?service_id=2f69fe6221634384b2def7860624fd52&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:34.275303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.311789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d15d4-4873-4459-8e08-18a144a66c02 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.345832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.346560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.346837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.347150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.353846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.355324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.366695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce4cd4-0823-46f5-84af-af03ebe6bc3f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:34.371560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:34.372545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 461/938] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:34.378614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.400519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.403979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.403979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.403979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.403979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:34.403979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.404406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.414080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 478/939] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:34.414080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.483831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5fa3a-4f12-4944-a8fd-597a299ef12c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.504176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b83bb-764e-443b-ab94-634b15a739df None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.516822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.517483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.517762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.518031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.518715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.520094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.525842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 462/940] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:03:34.526710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.550704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.551998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.552282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.552731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.553741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:34.554053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.556577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.574623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 479/941] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:34.581244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.642591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942c6d8-825a-4571-8151-5a5c3c1587c6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.679381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.680124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.680405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.680676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.681453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:34.681758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.683198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.693714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 463/942] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:34.696693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:34.714044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912ab1-170c-491f-993b-9c05843ac099 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.750157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006efd-e813-4b90-9f84-d26d6d775b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.751090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006efd-e813-4b90-9f84-d26d6d775b8f None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.751370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006efd-e813-4b90-9f84-d26d6d775b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.751639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006efd-e813-4b90-9f84-d26d6d775b8f None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/389b4a32ee1543f0a5111eea5e4b6b1a/roles/23e0684d61054741b4ebf0e309411f54` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.754527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006efd-e813-4b90-9f84-d26d6d775b8f None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=389b4a32ee1543f0a5111eea5e4b6b1a, role_id=23e0684d61054741b4ebf0e309411f54)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.756238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006efd-e813-4b90-9f84-d26d6d775b8f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.774577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 480/943] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:34 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/389b4a32ee1543f0a5111eea5e4b6b1a/roles/23e0684d61054741b4ebf0e309411f54 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:03:34.826653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986432fd-2086-4fcd-a419-e19208c1e043 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:34.865728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fae8ea-bed9-4dd1-afa1-96d78476f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:34.866418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae8ea-bed9-4dd1-afa1-96d78476f382 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:34.866699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae8ea-bed9-4dd1-afa1-96d78476f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:34.867016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae8ea-bed9-4dd1-afa1-96d78476f382 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:34.867874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fae8ea-bed9-4dd1-afa1-96d78476f382 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:34.869372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fae8ea-bed9-4dd1-afa1-96d78476f382 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:34.893809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 464/944] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:35.996310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530913d-931b-434d-9fda-c0df8060c267 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:35.996838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530913d-931b-434d-9fda-c0df8060c267 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:35.996838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530913d-931b-434d-9fda-c0df8060c267 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:35.998497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 481/945] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:36.003860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:36.004307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:36.004396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:36.022302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:36.023503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:36.100879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 465/946] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:36.124675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530913d-931b-434d-9fda-c0df8060c267 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:36.220179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530913d-931b-434d-9fda-c0df8060c267 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:36.256566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:36.257550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:36.258018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:36.258497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:36.259446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:36.261076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:36.262612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING keystone.server.flask.common [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 08:03:36.280022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.sql.core [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 08:03:36.280022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 08:03:36.280022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [parameters: {'id': '75d4a8ec87dd4b0485494586bddfe103', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 08:03:36.280022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80098) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75d4a8ec87dd4b0485494586bddfe103.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75d4a8ec87dd4b0485494586bddfe103. May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result = self._query(query) May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application conn.query(q) May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 08:03:36.297429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result.read() May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 08:03:36.298334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application next(self.gen) May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application yield resource May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application next(self.gen) May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.session.rollback() May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.force_reraise() May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise self.value May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application session.commit() May 04 08:03:36.299462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._prepare_impl() May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.session.flush() May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._flush(objects) May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application compat.raise_( May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application flush_context.execute() May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 08:03:36.300377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rec.execute(self) May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 08:03:36.302427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result = self._query(query) May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application conn.query(q) May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result.read() May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 08:03:36.304291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [parameters: {'id': '75d4a8ec87dd4b0485494586bddfe103', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:36.306411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:36.308305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75d4a8ec87dd4b0485494586bddfe103. May 04 08:03:36.310510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:36.313294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 482/947] 10.222.0.59 () {60 vars in 1140 bytes} [Wed May 4 08:03:36 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:36.323029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:36.421143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8f305-a815-4e95-85ab-5e108b2c387e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:36.455051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:36.455859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:36.456133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:36.456398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:36.463276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:36.464718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-4e2366bf-9c0b-4fd8-881a-0ba198e0b982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:36.478705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:36.480763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:36.482975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 466/948] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:36.486232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:36.585775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed6bb9-6dab-4fe4-9115-d8736fafef93 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:36.621219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:36.622397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:36.622951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:36.623435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:36.624396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:36.624897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:36.626735 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc275a-4ed8-4e20-b689-2f323bf4b9ac None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:36.647838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 483/949] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:36.930902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bcaaf-511b-4aee-8a75-07cbafa085df None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:36.931398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bcaaf-511b-4aee-8a75-07cbafa085df None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:36.931774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bcaaf-511b-4aee-8a75-07cbafa085df None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:36.933480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 467/950] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:36.938952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ebd4-6e75-4ad2-90e2-0d92a5efee26 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:36.939365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ebd4-6e75-4ad2-90e2-0d92a5efee26 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:36.939728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ebd4-6e75-4ad2-90e2-0d92a5efee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:36.957686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d572ebd4-6e75-4ad2-90e2-0d92a5efee26 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:36.959191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d572ebd4-6e75-4ad2-90e2-0d92a5efee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:37.033021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 484/951] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:37.056101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bcaaf-511b-4aee-8a75-07cbafa085df None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.098327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b6d8-689f-497f-8b4a-051a0a83d6be None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.098670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b6d8-689f-497f-8b4a-051a0a83d6be None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.098918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b6d8-689f-497f-8b4a-051a0a83d6be None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.100533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 485/952] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:37.107736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc11d97-fe20-4304-8430-724f21b321d7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.108138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc11d97-fe20-4304-8430-724f21b321d7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.108504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc11d97-fe20-4304-8430-724f21b321d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.125232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-6cc11d97-fe20-4304-8430-724f21b321d7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:37.126523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6cc11d97-fe20-4304-8430-724f21b321d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:37.161043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bcaaf-511b-4aee-8a75-07cbafa085df None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.194481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.195676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.196192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.196662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.197506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.199119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.203021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 486/953] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:37.214689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b2da-fec1-4321-a374-f0545f4ff970 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.215016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b2da-fec1-4321-a374-f0545f4ff970 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.215337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3b2da-fec1-4321-a374-f0545f4ff970 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.216862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 487/954] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:37.219588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:37.220575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.221421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 468/955] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:37.222292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.222292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.222292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.228758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.240406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:37.241551 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:37.303229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 488/956] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:37.304280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.330375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016393-d6f9-48d3-a769-da1e1a363b30 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.362576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.363465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.363768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.364064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.374632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:37.385604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:37.386750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:37.387997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.390681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 469/957] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:37.391565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.410334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c346fc-5702-4400-ae49-bb75f88013d9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.443860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.444576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.444802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.445075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.445779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:37.446082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.447495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.457101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 489/958] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:37.457101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.496832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab48d-db1d-4089-9baa-ec36d3e51fc8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.531681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.532473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.532747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.533008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.533653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.535037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.545963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02140be-5e4a-416c-bdf8-f7b2d6bde98b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:37.546591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:37.547673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.548554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 470/959] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:37.549397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.583725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.584389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.584666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.584934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.585668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:37.585968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.587374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.600959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 490/960] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:37.600959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.647698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effa13-9012-4a20-a0f7-4862d3922d2a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.680399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.681343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.681816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.682261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.683340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:37.683862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.685694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.690548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 471/961] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:37.690669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f645a2-556a-4821-8d4e-567d15277599 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.691632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.732722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.733312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.733589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.733859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.734569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:37.734869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.736263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.745457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 491/962] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:37.745457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.802108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9db98-2a39-4636-bfb5-ff9a352a129c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.837154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.837955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.838232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.838501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.838632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394ac51-f5e9-4897-a08e-42f8acac696b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:37.851594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.853294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:37.871012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:37.872373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:37.873328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:37.873328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:37.873328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:37.873328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:37.873328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 472/963] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:37.873328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:37.879808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:37.880477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:37.880758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:37.881026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:37.881808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:37.883247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:37.903643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 492/964] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:37.904569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:38.004675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1b8ed-cac1-427e-8183-fd68a777406a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:38.034713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ff790-ae18-454e-b811-a1d41190ebdc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:38.042359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:38.043442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:38.043969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:38.044489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:38.045512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:38.046073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:38.047709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:38.058360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 473/965] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:38.074403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:38.075230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:38.075509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:38.075860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:38.077269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:38.077817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:38.079815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:38.095024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 493/966] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:38.101010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:38.208200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686da026-8147-45d9-8a09-51ac7b04e61e None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:38.247326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:38.249270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:38.249270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:38.249270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:38.257405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:38.259111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:38.274423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:38.275629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 08:03:38.276825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:38.279145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 474/967] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:03:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:38.284971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:38.389399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801976-d3df-4899-8867-e8c4b712ee43 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:38.423631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:38.424297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:38.424570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:38.424836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:38.425668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:38.425970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:38.427480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:38.445600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 494/968] 10.222.0.59 () {56 vars in 1149 bytes} [Wed May 4 08:03:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:38.451080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:38.549336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd8bf-3a3d-4b1c-a5b7-43be23f95bdf None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:38.583104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:38.583748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:38.584031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:38.584347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:38.649410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:38.650860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:38.747708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 475/969] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:38 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:38.753338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:38.856122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a250-1430-463c-a96e-2d7932c55346 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:38.891600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:38.892402 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:38.892672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:38.892932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:38.902995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:38.904858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-9fbe2690-d05b-49a1-b453-ce16b204b565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:38.922019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:38.922999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:38.923945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:38.923945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:38.923945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:38.923945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:38.923945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 495/970] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:38.928853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.023173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d69e-c751-4a80-a675-f619c727773b None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.023547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d69e-c751-4a80-a675-f619c727773b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.023877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d69e-c751-4a80-a675-f619c727773b None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.025697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 496/971] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:39.029380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3543a-6b5b-487a-beed-434ac650f1d2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.030709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.031248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.031721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.049460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:39.051527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:39.066483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.067334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.067629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.067886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.068638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:39.068938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.070296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.082055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 476/972] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:39.087766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.131055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 497/973] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:39.150498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.190657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c0bd9-9ae3-4a57-b2f8-f66b3544c410 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.225366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.226180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.226459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.226729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.233686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.235227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:39.249327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:39.250344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:39.251390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 477/974] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:39.256322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.263679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e420b6-e27d-4ab3-9d64-ad86dbc2e22a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.300209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.301174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.301653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.302246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.303217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.304873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.319011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.sql.core [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 08:03:39.319011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 08:03:39.319011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [parameters: {'user_id': '3a0ba4c7ae1842bd9a55475cfa8ac8f1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 08:03:39.319011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80098) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result = self._query(query) May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application conn.query(q) May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result.read() May 04 08:03:39.328855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 08:03:39.329775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application next(self.gen) May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application yield resource May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application next(self.gen) May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.session.rollback() May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.force_reraise() May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise self.value May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application session.commit() May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 08:03:39.330790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._prepare_impl() May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.session.flush() May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._flush(objects) May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application compat.raise_( May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application flush_context.execute() May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rec.execute(self) May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 08:03:39.331769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 08:03:39.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result = self._query(query) May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application conn.query(q) May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application result.read() May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 08:03:39.333726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [parameters: {'user_id': '3a0ba4c7ae1842bd9a55475cfa8ac8f1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:39.334603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 08:03:39.335908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:39.336881 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 498/975] 10.222.0.59 () {60 vars in 1131 bytes} [Wed May 4 08:03:39 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:39.344349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.370490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e70f3b-0022-4d69-b029-0e0c6fadd066 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.425681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.426701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.427212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.427685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.428718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:39.429221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.431282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.447965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 478/976] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:39.453836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.459297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5732e3-dfdf-404a-8693-630cd73019d5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.493062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.493907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.494233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.494490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.502426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.504152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:39.520463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:39.521521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 08:03:39.522577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:39.526334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 499/977] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:39.527234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:39.584435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba9f15-3a99-4231-9ff4-89d9aa1e34f7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.626651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb02f42-926d-4f5b-929d-7fb7d877de96 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:39.630463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.631465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.631955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.632440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.633908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] RBAC: Adding query filter params (role.id=23e0684d61054741b4ebf0e309411f54, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=389b4a32ee1543f0a5111eea5e4b6b1a) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:39.634424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.636430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b6e19-e11e-438f-905f-8b1bede159da None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.644904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 479/978] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:39 2022] GET /identity/v3/role_assignments?user.id=389b4a32ee1543f0a5111eea5e4b6b1a&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=23e0684d61054741b4ebf0e309411f54 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:39.662114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:39.662724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:39.663035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:39.663361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:39.664227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:39.664531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:39.666017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1640a-6efc-4d01-b571-6d48da5bf7db None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:39.709168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 500/979] 10.222.0.59 () {56 vars in 1101 bytes} [Wed May 4 08:03:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:40.255147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b93b1-c925-42e1-82d2-b2ba36197aad None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.255725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b93b1-c925-42e1-82d2-b2ba36197aad None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.255725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b93b1-c925-42e1-82d2-b2ba36197aad None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.257183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 480/980] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:40.262267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e4b7-23c4-4536-81b0-6ff5f2c09e80 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.262672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e4b7-23c4-4536-81b0-6ff5f2c09e80 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.262862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5e4b7-23c4-4536-81b0-6ff5f2c09e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.279861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1ea5e4b7-23c4-4536-81b0-6ff5f2c09e80 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:40.281321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1ea5e4b7-23c4-4536-81b0-6ff5f2c09e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:40.345919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 501/981] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:40.349898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65aa08-62ed-47e9-b11b-c358c63ffb57 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.350186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65aa08-62ed-47e9-b11b-c358c63ffb57 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.350461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65aa08-62ed-47e9-b11b-c358c63ffb57 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.351834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 481/982] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:40.357012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.357303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.357578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.367742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65aa08-62ed-47e9-b11b-c358c63ffb57 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:40.374378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:40.375578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:40.447107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 502/983] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:40.469818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:40.476367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65aa08-62ed-47e9-b11b-c358c63ffb57 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:40.509678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:40.510410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.510682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.510977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.511616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:40.513106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:40.524775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:40.525843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:40.526776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:40.530999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 482/984] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:40.531845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:40.576303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868226-58ca-458b-8d7d-24cb89243eda None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:40.615853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:40.616520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.616804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.617109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.617865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:40.619328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:40.628662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221e23-1ecf-435c-a923-7ea8900aa3fe None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:40.633083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 503/985] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:40 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:03:40.678180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:40.679069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.679374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.679710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.680668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:40.681031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:40.682541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:40.693420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 483/986] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:40.694818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:40.805549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7f75e-c807-47ea-9fb9-92d962193e43 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:40.843168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:40.843822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.844124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.844414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.845220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:40.845517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:40.846934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:40.852212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 504/987] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:40.858385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:40.955133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5061db-46ef-4fb4-86d2-d8cb7e0b71ab None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:40.986891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:40.987541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:40.987817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:40.988086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:40.988871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] RBAC: Adding query filter params (interface=admin, service_id=2f69fe6221634384b2def7860624fd52, region_id=RegionOne) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:40.989173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:40.990553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4b23e-2395-4cd9-9caa-5528e24f3995 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:40.995530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 484/988] 10.222.0.59 () {56 vars in 1249 bytes} [Wed May 4 08:03:40 2022] GET /identity/v3/endpoints?service_id=2f69fe6221634384b2def7860624fd52&interface=admin®ion_id=RegionOne => generated 193 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:41.001271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:41.097550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbd15a-28fc-4411-8807-e85251848256 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:41.130499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c995415-d4f8-4191-8e8e-2b23a8980add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:41.131231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995415-d4f8-4191-8e8e-2b23a8980add None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:41.131522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995415-d4f8-4191-8e8e-2b23a8980add None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:41.131775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995415-d4f8-4191-8e8e-2b23a8980add None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:41.132453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c995415-d4f8-4191-8e8e-2b23a8980add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:41.133816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c995415-d4f8-4191-8e8e-2b23a8980add None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:41.147037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 505/989] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:41 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:03:41.939815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeda3-1cc3-40ba-b9ad-31ce7b8a16a8 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:41.940387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeda3-1cc3-40ba-b9ad-31ce7b8a16a8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:41.940387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeda3-1cc3-40ba-b9ad-31ce7b8a16a8 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:41.941853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 485/990] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:41.947213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:41.947619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:41.947718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:41.964442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:41.965581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:42.031079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 506/991] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:42.052968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beeda3-1cc3-40ba-b9ad-31ce7b8a16a8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:42.156626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beeda3-1cc3-40ba-b9ad-31ce7b8a16a8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:42.190142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:42.190848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:42.191183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:42.191452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] PATH_INFO: `/v3/services/image` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:42.192396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:42.193748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:42.205212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:42.206233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:42.207124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:42.211221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 486/992] 10.222.0.59 () {56 vars in 1105 bytes} [Wed May 4 08:03:42 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:42.212360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:42.311857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6c1a3-c9d8-4931-b6da-28039b069089 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:42.345756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:42.346417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:42.346687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:42.347051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:42.347734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] RBAC: Adding query filter params (name=image) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:42.348028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:42.349385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e898ef-cbd4-4bc3-8b05-7f667399cf5d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:42.354244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 507/993] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:42.359766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:42.465549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd0f50-e94e-4226-9fcf-6c0967242bec None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:42.499081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:42.499743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:42.500020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:42.500291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:42.500994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:42.501293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:42.502650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2fc6dd-05b9-4bcc-970f-34263022b4d4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:42.507271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 487/994] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:42.889775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f65e2-dd67-47e8-9be2-dbc82851af12 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:42.890116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f65e2-dd67-47e8-9be2-dbc82851af12 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:42.890386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f65e2-dd67-47e8-9be2-dbc82851af12 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:42.891837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 508/995] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:42.897589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:42.897854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:42.898150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:42.914712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:42.915916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:42.983373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 488/996] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:43.006403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f65e2-dd67-47e8-9be2-dbc82851af12 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.110360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f65e2-dd67-47e8-9be2-dbc82851af12 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.143679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.144395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.144674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.144901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.145569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.146982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:43.159084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:43.160130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:43.161011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 509/997] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:43.167998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.268957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db95a3-0b5f-4c0a-9793-4c45da7e4f71 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.303233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.303901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.304175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.304443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.305152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:43.305452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.306808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015f92-b7dc-43fe-b5f6-407e27b270d4 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.311891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 489/998] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:43.318183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.375371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b3fe-2528-4b80-a4c7-1720140a0513 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.375719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b3fe-2528-4b80-a4c7-1720140a0513 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.375896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b3fe-2528-4b80-a4c7-1720140a0513 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.377432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 490/999] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:43.382237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.382522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.382796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.404027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:43.404027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:43.422582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b18649-424f-4516-86d9-8b4f568c92cc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.459979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.460667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.460964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.461249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.461959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:43.462262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.463676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.468650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 510/1000] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:43.469216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 491/1001] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:43.474743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.492179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.571170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2814-b8db-4237-94ca-6d96c97cf93d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.586693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c390d7-2a13-4c3d-b579-5cd55220b3dc None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.605275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.605944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.606682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.606682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.607416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] RBAC: Adding query filter params (interface=public, service_id=d5a96e25abd04423ae68e8769bc07028, region_id=RegionOne) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:43.607767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.609247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.614831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 511/1002] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/endpoints?service_id=d5a96e25abd04423ae68e8769bc07028&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:43.620747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.627265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.628088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.628362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.628629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.629283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.630644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:43.642722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:43.643853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 08:03:43.644754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:43.648937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 492/1003] 10.222.0.59 () {56 vars in 1126 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:43.649768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.715565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6efc9-fe89-4a61-9364-85e4911d9cb5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.742523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6b69-7e78-4eb3-9765-15f6a575cc10 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.747782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.748443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.748717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.748985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.749657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.751048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.757612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 512/1004] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:03:43.775913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.776600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.776877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.777181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.777900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:43.778240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.779672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.790162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 493/1005] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:43.791208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:43.894635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7dda8-9bef-427c-b4f3-a5ec35ec8811 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:43.930602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:43.931301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:43.931578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:43.931847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:43.932555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:43.932856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:43.934224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686c97-dbce-401a-aa44-ed751fca8334 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:43.939839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 513/1006] 10.222.0.59 () {56 vars in 1122 bytes} [Wed May 4 08:03:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:43.946418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:44.043279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7a3d2-56f0-4c40-a372-b3d32a9c0ffd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:44.077312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082082-1329-4df0-a616-ee87eee06b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:44.077980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082082-1329-4df0-a616-ee87eee06b68 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:44.078257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082082-1329-4df0-a616-ee87eee06b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:44.078531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082082-1329-4df0-a616-ee87eee06b68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:44.079302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082082-1329-4df0-a616-ee87eee06b68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:44.080742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082082-1329-4df0-a616-ee87eee06b68 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:44.102917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 494/1007] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:44.726797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65251e-24b3-4df7-a5ef-9370bc288dc7 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:44.727320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65251e-24b3-4df7-a5ef-9370bc288dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:44.727320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65251e-24b3-4df7-a5ef-9370bc288dc7 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:44.728712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 514/1008] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:44.734092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a36a-5e55-4f76-9069-a5604c8e889c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:44.734384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a36a-5e55-4f76-9069-a5604c8e889c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:44.734626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9a36a-5e55-4f76-9069-a5604c8e889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:44.751731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7cf9a36a-5e55-4f76-9069-a5604c8e889c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:44.752889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7cf9a36a-5e55-4f76-9069-a5604c8e889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:44.824910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 495/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:44 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:44.847315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65251e-24b3-4df7-a5ef-9370bc288dc7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:44.951258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65251e-24b3-4df7-a5ef-9370bc288dc7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:44.982914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bbac0-3189-4c8c-8921-0af3a9182baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:44.983394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bbac0-3189-4c8c-8921-0af3a9182baa None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:44.983681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bbac0-3189-4c8c-8921-0af3a9182baa None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:44.983914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bbac0-3189-4c8c-8921-0af3a9182baa None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:44.984633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bbac0-3189-4c8c-8921-0af3a9182baa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:44.986135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bbac0-3189-4c8c-8921-0af3a9182baa None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:45.006925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 515/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:44 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:45.981924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3eac-8d28-4ddd-8b3b-a2759cebddca None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:45.982473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3eac-8d28-4ddd-8b3b-a2759cebddca None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:45.982473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b3eac-8d28-4ddd-8b3b-a2759cebddca None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:45.983814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 496/1011] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:45.989497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:45.989952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:45.990033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.007116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:46.008265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:46.086449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 516/1012] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:45 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:46.109072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3eac-8d28-4ddd-8b3b-a2759cebddca None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:46.214399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b3eac-8d28-4ddd-8b3b-a2759cebddca None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:46.246143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:46.246968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.247231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.247497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.248138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:46.249490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-08c9029b-57b3-4bd0-8542-c1e4a765de07 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:46.260730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:46.261741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 08:03:46.262630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:46.266843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 497/1013] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:46.268118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:46.334350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21c03-fd3c-4f0e-b7a4-1d6bee3996fe None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.334686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21c03-fd3c-4f0e-b7a4-1d6bee3996fe None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.334848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21c03-fd3c-4f0e-b7a4-1d6bee3996fe None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.336432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 498/1014] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:46.341333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.341576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.341876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.358008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:46.359175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:46.370146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45aff3-b831-4e00-b3fb-7f69245d785d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:46.410639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:46.411331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.411609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.411875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.412578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] RBAC: Adding query filter params (name=compute) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:46.412874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:46.414237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:46.419645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 517/1015] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:46.425186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:46.443165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 499/1016] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:46 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:46.466231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:46.525856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ae58-eeb2-4fbf-8b1d-67a8eebe46df None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:46.558401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:46.559099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.559411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.559665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.560377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:46.560680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:46.561693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64182a7e-1238-43a9-bb08-b6be26943875 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:46.562049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:46.567677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 518/1017] 10.222.0.59 () {56 vars in 1112 bytes} [Wed May 4 08:03:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:46.573038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:46.595152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:46.595948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.596221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.596472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.597670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:46.599154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:46.605354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 500/1018] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:46.607014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:46.669065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312bf7-38c9-4284-85af-fcfc9e4735f9 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:46.701436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265c54e-c31c-4dc4-939a-1e12cc54731c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:46.703385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff6236-5b51-4836-a8af-2611ca9d598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:46.704035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6236-5b51-4836-a8af-2611ca9d598e None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.704305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6236-5b51-4836-a8af-2611ca9d598e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.704599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6236-5b51-4836-a8af-2611ca9d598e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.705334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff6236-5b51-4836-a8af-2611ca9d598e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:46.706711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff6236-5b51-4836-a8af-2611ca9d598e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:46.734913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 519/1019] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:03:46.751898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bb1c3-8dca-46f6-836d-5a417f42fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:46.752572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb1c3-8dca-46f6-836d-5a417f42fd54 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:46.752848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb1c3-8dca-46f6-836d-5a417f42fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:46.753117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bb1c3-8dca-46f6-836d-5a417f42fd54 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:46.753825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb1c3-8dca-46f6-836d-5a417f42fd54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:46.755327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bb1c3-8dca-46f6-836d-5a417f42fd54 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:46.784504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 501/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:03:46 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:03:47.267791 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62af1f-fb3f-40c1-a055-478988d99672 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:47.268334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62af1f-fb3f-40c1-a055-478988d99672 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:47.268334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62af1f-fb3f-40c1-a055-478988d99672 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:47.269663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 520/1021] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:47.275115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:47.275520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:47.275712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:47.292300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:47.293467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:47.356061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 502/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:47.378832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62af1f-fb3f-40c1-a055-478988d99672 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:47.480948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62af1f-fb3f-40c1-a055-478988d99672 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:47.514897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:47.515712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:47.515986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:47.516250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] PATH_INFO: `/v3/services/image` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:47.516895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:47.518320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:47.529689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:47.530737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:47.531964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:47.535275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 521/1023] 10.222.0.59 () {56 vars in 1105 bytes} [Wed May 4 08:03:47 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:47.536834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:47.635347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce3ce5-f296-42e4-acb6-94b8fc917f08 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:47.669266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:47.669932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:47.670177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:47.670478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:47.671209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:47.671506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:47.672865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:47.678105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 503/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:47.683780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:47.786065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e62be-6255-4c16-bd31-1d34f5e0054a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:47.819667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:47.820332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:47.820603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:47.820868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:47.821576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] RBAC: Adding query filter params (type=image) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:47.821874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:47.823265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:47.828405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 522/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:47.834094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:47.930200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025149f3-83dd-41cc-869b-4b0d43b077b1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:47.967488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:47.968548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:47.969055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:47.969521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:47.970532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] RBAC: Adding query filter params (interface=public, service_id=9785c6ed6864478a8b15282dbb0802a9, region_id=RegionOne) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:47.971084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:47.972689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aaead-0083-426b-a53b-2b8b65c6b396 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:47.979130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 504/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:03:47 2022] GET /identity/v3/endpoints?service_id=9785c6ed6864478a8b15282dbb0802a9&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:47.984663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:48.082990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb40f6-c952-41b1-bd8c-f468998f4e3f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:48.115548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d926e-acf5-4277-a3fc-d215ecc3a4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:48.116209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d926e-acf5-4277-a3fc-d215ecc3a4ff None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:48.116449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d926e-acf5-4277-a3fc-d215ecc3a4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:48.116751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d926e-acf5-4277-a3fc-d215ecc3a4ff None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:48.117429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d926e-acf5-4277-a3fc-d215ecc3a4ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:48.118816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d926e-acf5-4277-a3fc-d215ecc3a4ff None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:48.130913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 523/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:03:47 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:03:49.062149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff12b7-ef12-4853-abea-93f6e414baba None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.062718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff12b7-ef12-4853-abea-93f6e414baba None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.062718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff12b7-ef12-4853-abea-93f6e414baba None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.064039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 505/1028] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:49.069867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.070317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.070405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.074419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d016b-58c1-4045-8a85-c7e620d6aebc None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.074734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d016b-58c1-4045-8a85-c7e620d6aebc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.075046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d016b-58c1-4045-8a85-c7e620d6aebc None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.077404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 506/1029] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:49.081216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.081484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.081761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.088276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:49.089431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:49.100128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:49.101298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:49.162946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 524/1030] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:49.173017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 507/1031] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:49.186744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.196023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.293230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7778c-e653-4ecd-8849-ef8ad4672802 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.293742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95123a2b-344e-4094-8fb9-fd6a1215ed36 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.328569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.328758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.329304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.329455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.329590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.329849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.329940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.330184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.331593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:49.332985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:49.334870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 525/1032] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:49.340097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.344648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:49.352733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:49.353685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:49.354722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 508/1033] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 4 08:03:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:49.359844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.444673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b692-8fe9-4baa-95d8-c6561ee1fac2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.462334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452616-1116-4e85-bb43-37fc70b53592 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.477562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.478225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.478499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.478764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.479486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:49.480933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:49.493998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.494651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.494939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.495202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.495949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:49.496277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:49.497608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:49.510196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 509/1034] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:03:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:49.510624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 526/1035] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:03:49 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:03:49.511704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.617681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b08934-7e03-42e0-ac57-dde407895c1c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.653698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.654516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.654795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.655118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.666705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:49.668204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:49.686283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:49.687600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:49.688546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:49.688546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:49.688546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:49.688546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:49.688546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 510/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:49.693838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.797204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218571-70c9-4453-a0b5-aabff986c02f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.829848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.830831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.831272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.831684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.832544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:49.833012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:49.834533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:49.846492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 527/1037] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:49.852472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:49.950424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581db65c-0802-44a6-b6cf-4d1a9204c6f2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:49.984273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:49.985073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:49.985375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:49.985647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:49.993370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:49.994810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:50.008720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:50.009709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:50.010718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:50.014777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 511/1038] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:50.015835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.114946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb021f-26e8-418c-b98b-dfa8745e76de None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.148655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.149288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.149569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.149812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.150667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:50.151006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.152445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180ffa-e212-4da0-b691-96caa046b46f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.171509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 528/1039] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:50.177274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.280738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be416b70-2cc5-4dd3-92eb-979dc5517cad None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.314595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.315445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.315821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.316211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.355482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad94d-c241-49fb-836a-075086424dab None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.355752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad94d-c241-49fb-836a-075086424dab None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.356099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad94d-c241-49fb-836a-075086424dab None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.357622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 529/1040] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:50.362300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.362613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.362855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.379921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:50.381091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:50.386137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.387869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.446917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 530/1041] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:50.468230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.485031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 512/1042] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:50.490831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.569780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2e9a-cd41-4232-a72d-8bd41527d192 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.583524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213de8c-0d25-4ddf-8066-bd71934ddecc None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.603002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.603815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.604076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.604349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.605002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.606692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.616068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.616861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.617135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.617401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:50.618270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:50.619299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:50.620168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 531/1043] 10.222.0.59 () {56 vars in 1105 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:50.626208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.632790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.634235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:50.651283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:50.652276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:50.653461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:50.653461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:50.653461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:50.653461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:50.653461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 513/1044] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:50.658043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.731526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6aab6b-50e9-4db7-86c9-6b76946530a7 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.757708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351789e-28ec-40b1-96d5-4c255a0561fd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.763987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.764650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.764925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.765197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.765895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] RBAC: Adding query filter params (name=image) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:50.766263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.767676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.773157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 532/1045] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:50.779219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.791951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.792610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.792883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.793148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.794018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:50.794315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.795704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.811421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 514/1046] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:50.812199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.879440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbdbe8-ab9d-4d01-8985-d1cc0e5e5303 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.905133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a435c3-f7e8-470b-923e-8f540abce253 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:50.916420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.917079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.917354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.917681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.918403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] RBAC: Adding query filter params (type=image) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:50.918729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.920127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.924833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 533/1047] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:50.930268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:50.939069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:50.939876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:50.940152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:50.940419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:50.947318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:50.948755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:50.962609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:50.963574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:50.964609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:50.968633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 515/1048] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:50.969676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:51.027995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de052990-84b4-4910-a1f7-335f7f0f5357 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:51.061458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:51.062118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:51.062397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:51.062670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:51.063431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:51.064674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08ecdb-43f4-4f77-b377-ad1ca9bda31a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:51.064789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:51.084710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 534/1049] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:03:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:03:51.109483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:51.110828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:51.111305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:51.111716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:51.112662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:51.113109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:51.114723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd078c-c22c-4a28-b8a3-b0ca6cb1e301 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:51.132032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 516/1050] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:51.138129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:51.253969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c2715-29aa-43ba-8f78-14cd4cbb7258 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:51.289982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:51.290650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:51.290950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:51.291225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:51.292055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] RBAC: Adding query filter params (role.id=23e0684d61054741b4ebf0e309411f54, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=268f6afa0af84c6b9a6807975bb8db87) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:51.292364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:51.293913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de9f69-37ed-487d-a9d5-dd481788c3af None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:51.299721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 535/1051] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:51 2022] GET /identity/v3/role_assignments?user.id=268f6afa0af84c6b9a6807975bb8db87&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=23e0684d61054741b4ebf0e309411f54 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:51.811416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc759-7b94-4ab6-988d-1ac02656e9cf None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:51.811964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc759-7b94-4ab6-988d-1ac02656e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:51.811964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc759-7b94-4ab6-988d-1ac02656e9cf None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:51.813358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 517/1052] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:51.819081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:51.819345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:51.819633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:51.836442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:51.837589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:51.900780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 536/1053] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:51.923555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc759-7b94-4ab6-988d-1ac02656e9cf None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:52.022813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc759-7b94-4ab6-988d-1ac02656e9cf None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:52.056809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:52.057595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:52.057866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:52.058134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:52.068453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:52.075999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:52.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:52.083120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 518/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:52.083864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:52.184500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf573-4b38-4161-bb8d-49a6f29f356f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:52.221126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:52.221808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:52.222089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:52.222328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:52.223109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:52.223407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:52.224770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:52.233580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 537/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:52.239440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:52.339630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ee48a-ce21-4983-94e5-53090b53aba1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:52.373263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:52.374137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:52.374416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:52.374687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] PATH_INFO: `/v3/users/9b92940f3d3c47c38e79f05beadbd4aa` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:52.388564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] RBAC: Authorizing `identity:get_user(user_id=9b92940f3d3c47c38e79f05beadbd4aa)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:52.390046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:52.392054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 519/1056] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:03:52 2022] GET /identity/v3/users/9b92940f3d3c47c38e79f05beadbd4aa => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:52.397867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:52.499394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c388ac-11d1-4e07-847c-3d32dfc44fa2 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:52.531840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:52.532482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:52.532758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:52.533024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:52.597676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:52.599127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:52.694453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 538/1057] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:52.700089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:52.798004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39572e1-bd8e-40a8-961e-194cbd53f230 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:52.831620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28562af-f3e4-4e18-aecc-7624d64519ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:52.832638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28562af-f3e4-4e18-aecc-7624d64519ea None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:52.832922 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28562af-f3e4-4e18-aecc-7624d64519ea None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:52.833195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28562af-f3e4-4e18-aecc-7624d64519ea None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:52.834395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28562af-f3e4-4e18-aecc-7624d64519ea None admin] RBAC: Authorizing `identity:get_project(project_id=eca3a072fa9045f1a80bc00020472e49)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:52.835860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28562af-f3e4-4e18-aecc-7624d64519ea None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:52.842638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 520/1058] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:03:52 2022] GET /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:52.843955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:52.940565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265427eb-cc57-4151-be15-8ad39d7ff9cc None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:52.975335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:52.976034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:52.976309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:52.976632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:52.977456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=eca3a072fa9045f1a80bc00020472e49, user.id=9b92940f3d3c47c38e79f05beadbd4aa) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:52.977761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:52.979224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f445b8-f2b8-4b00-901a-e689af1e8cc1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:52.990948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 539/1059] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:52 2022] GET /identity/v3/role_assignments?user.id=9b92940f3d3c47c38e79f05beadbd4aa&scope.project.id=eca3a072fa9045f1a80bc00020472e49&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:53.359142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c3fba-437f-4dcf-9d32-56a1b431fc8b None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.359490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c3fba-437f-4dcf-9d32-56a1b431fc8b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.359697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c3fba-437f-4dcf-9d32-56a1b431fc8b None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.361091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 521/1060] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:53.366408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a264b-2e64-431f-acfb-052f9f9e0f9c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.366919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a264b-2e64-431f-acfb-052f9f9e0f9c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.367003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a264b-2e64-431f-acfb-052f9f9e0f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.385758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2b9a264b-2e64-431f-acfb-052f9f9e0f9c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:53.385758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2b9a264b-2e64-431f-acfb-052f9f9e0f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:53.453766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 540/1061] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:53.476603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c3fba-437f-4dcf-9d32-56a1b431fc8b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:53.499753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1206601-208a-45eb-aeef-dd80efac89af None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.500070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1206601-208a-45eb-aeef-dd80efac89af None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.500314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1206601-208a-45eb-aeef-dd80efac89af None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.501983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 541/1062] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:53.506669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.506956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.507224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.523414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:53.524570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:53.583725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c3fba-437f-4dcf-9d32-56a1b431fc8b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:53.589510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 542/1063] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:53.611578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:53.620651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:53.621325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.621673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.621941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.688926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:53.690378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:53.704714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaef05-b583-4908-847e-0608abfe7c14 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:53.737534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:53.738345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.738615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.738900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.748811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:53.756817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:53.757814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:53.758739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:53.763227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 543/1064] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 4 08:03:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:53.764205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:53.786456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 522/1065] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:03:53.792179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:53.867001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147730dd-2b8b-4d52-b324-22f4bbc9b0e0 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:53.885331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745583-57fd-429c-a62d-25c055df840c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:53.899372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:53.900036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.900316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.900585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.901337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:53.901641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:53.903145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:53.915654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 544/1066] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:03:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:53.916648 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:53.917341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:53.918128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:53.918464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:53.918727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:53.928742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:53.930176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:53.947554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:53.948505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:53.954659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:53.954659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:53.954659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:53.954659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:53.954659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 523/1067] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:53.956308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:54.018958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b1dbc-7f22-4050-a129-512d9d029e46 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.051780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271952db-062f-4b20-ac80-128b5ff39130 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.052134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.052877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.053153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.053421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.064113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.065577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:54.082768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:54.083787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:54.084707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:54.084707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:54.084707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:54.084707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:54.084707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 545/1068] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:54.088016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.088977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.089087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.089411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.089943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:54.090308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:54.090611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.092033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.104663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 524/1069] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:54.208130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e93e5-7093-435d-8329-42bcc5d361cf None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.245581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.246276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.246540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.246813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.247576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:54.247885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.249279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.266963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 546/1070] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:54.268885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:54.369593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96aa2-78c3-489b-8772-03284a44d448 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.409259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.410061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.410335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.410604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.418466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.420084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:54.433813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:54.434860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:54.436498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 525/1071] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:54.440903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:54.540429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368ec94-bd71-40a7-94ba-7cdc00f3e8df None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.575631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.576337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.576613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.576907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.577775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:54.578108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.579606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.596718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 547/1072] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:54.602432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:54.703887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cb23-fe68-42ab-9def-5016dfae8706 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.738895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.739720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.739950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.740260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.751147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.752574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:54.769814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:54.770783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:54.772133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:54.772133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:54.772133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:54.772133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:54.772133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 526/1073] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:54.776961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:54.874149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edcd32-8aed-4a84-a1e7-41e80ed9c9b8 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:54.908552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:54.909207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:54.909488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:54.909756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:54.910471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:54.910769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:54.912298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:54.923624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 548/1074] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:54.929532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.033307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d06d96-7264-486a-ab21-60d43a7ac6f2 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.069909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.070707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.071015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.071286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.078186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:55.079649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-5ba26deb-3a13-4419-8896-d83a95d1ec7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:55.094014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:55.094984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:55.096080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 527/1075] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:55.101177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.198401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e040e-7d9d-4de7-988e-9651663a5563 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.213362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa916-b462-4567-8b0a-0ef578bce350 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.213615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa916-b462-4567-8b0a-0ef578bce350 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.213917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa916-b462-4567-8b0a-0ef578bce350 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.215355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 528/1076] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:03:55.220182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.220456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.220695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.232129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.232795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.233095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.233366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.234151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:55.234453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:55.235943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:55.236998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:55.238150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:55.248419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 549/1077] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:55.254236 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.303831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 529/1078] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:03:55.326574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.350060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9612e-6c5c-4c38-978c-5133b58157af None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.382606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.383518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.383798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.384024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/268f6afa0af84c6b9a6807975bb8db87/roles/23e0684d61054741b4ebf0e309411f54` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.386279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=268f6afa0af84c6b9a6807975bb8db87, role_id=23e0684d61054741b4ebf0e309411f54)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:55.387770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:55.401898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 550/1079] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:55 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/268f6afa0af84c6b9a6807975bb8db87/roles/23e0684d61054741b4ebf0e309411f54 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:03:55.423281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63e960-e9af-4697-8e76-d112a41d0a9b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.462693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.463476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.463752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.464006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.475700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:55.483647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:55.484883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:55.485842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 530/1080] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:55.491198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.596793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a94845-eac1-4a71-a621-e60c57bdf68b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.630910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.631584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.631859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.632119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.632862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:55.633155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:55.634512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:55.642623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 551/1081] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:55.649714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.751079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12689e7-6143-471e-822b-0de67cc306f0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.783881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.784746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.785021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.785279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] PATH_INFO: `/v3/users/9b92940f3d3c47c38e79f05beadbd4aa` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.786453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9b92940f3d3c47c38e79f05beadbd4aa)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:55.787900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:55.789536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 531/1082] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:03:55 2022] GET /identity/v3/users/9b92940f3d3c47c38e79f05beadbd4aa => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:55.795612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:55.896603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8555b6-fc76-4bac-bf49-c91414e07f3a None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:55.930156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519b7e-0baa-4370-a725-91a7af5946eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:55.931091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519b7e-0baa-4370-a725-91a7af5946eb None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:55.931372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519b7e-0baa-4370-a725-91a7af5946eb None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:55.931675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519b7e-0baa-4370-a725-91a7af5946eb None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:55.932916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519b7e-0baa-4370-a725-91a7af5946eb None admin] RBAC: Authorizing `identity:get_project(project_id=eca3a072fa9045f1a80bc00020472e49)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:55.934519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519b7e-0baa-4370-a725-91a7af5946eb None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:55.936259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 552/1083] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:03:55 2022] GET /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:55.942771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:56.039268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce6b05-6bb4-40d2-922a-0775648984a9 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:56.075461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923d397-7a8a-4add-8199-9b8fc41ece4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:56.076349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d397-7a8a-4add-8199-9b8fc41ece4a None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:56.076625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d397-7a8a-4add-8199-9b8fc41ece4a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:56.076899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923d397-7a8a-4add-8199-9b8fc41ece4a None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49/users/9b92940f3d3c47c38e79f05beadbd4aa/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:56.078901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923d397-7a8a-4add-8199-9b8fc41ece4a None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3a072fa9045f1a80bc00020472e49, user_id=9b92940f3d3c47c38e79f05beadbd4aa, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:56.080354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923d397-7a8a-4add-8199-9b8fc41ece4a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:56.093390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 532/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:03:55 2022] PUT /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49/users/9b92940f3d3c47c38e79f05beadbd4aa/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:03:57.616192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa533-1b80-4db8-9787-f35d9ffd2271 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:57.616740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa533-1b80-4db8-9787-f35d9ffd2271 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:57.616740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfa533-1b80-4db8-9787-f35d9ffd2271 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:57.618165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 553/1085] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:57.623662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:57.624119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:57.624213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:57.641273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:57.642435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:57.717812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 533/1086] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:57.742307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa533-1b80-4db8-9787-f35d9ffd2271 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:57.849078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfa533-1b80-4db8-9787-f35d9ffd2271 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:57.883525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:57.884325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:57.884597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:57.884863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:57.896735 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:57.904763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:57.905928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:57.906859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 554/1087] 10.222.0.59 () {56 vars in 1120 bytes} [Wed May 4 08:03:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:57.912534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.013058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eb9bd-8ef4-4a9e-9499-4c985ad9c07e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.046655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.047340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.047623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.047889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.048634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:58.048932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.050280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.058231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 534/1088] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:03:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:58.064107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.163712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42682db6-b002-4fe9-9e68-3133e13fd7c3 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.200594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.201382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.201662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.201931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.212215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.213661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-b0ce5ce8-f7be-4eeb-ba3e-b4b70c2f7067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:58.231185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:58.232124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:58.233049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:58.233049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:58.233049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:58.233049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:58.233049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 555/1089] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:58.238264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.338346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcbeb2-8aa6-4741-ac4a-da16eb09bf99 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.342005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97b14-e1aa-4cf2-aead-d0582d2ea24e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.342296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97b14-e1aa-4cf2-aead-d0582d2ea24e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.342566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf97b14-e1aa-4cf2-aead-d0582d2ea24e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.343957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 556/1090] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:03:58.348915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.349198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.349472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.367107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:03:58.368278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:03:58.372290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.372957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.373237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.373528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.374306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:58.374635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.376096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.388599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 535/1091] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:58.394390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.433580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 557/1092] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:03:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:03:58.458341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.492807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335a45-d7cb-4408-8754-afe65272d5bd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.529021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.529845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.530149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.530419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.537675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.539150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.552751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a821ca-3429-44d7-8a8a-5d0e599f67a6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:03:58.553486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:58.554537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:58.556075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 536/1093] 10.222.0.59 () {56 vars in 1093 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:58.560409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.586905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.587729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.588005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.588272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.599507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:03:58.607115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:58.608170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:03:58.609586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 558/1094] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:58.614230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.658318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d648e9-246f-4e40-a210-e2779186a810 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.692582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.693231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.693531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.693796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.694627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:58.694940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.696512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.710181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9291a69-6c64-4207-8910-d689983cc1e1 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.713688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 537/1095] 10.222.0.59 () {56 vars in 1133 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:58.719390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.743399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.744071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.744348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.744621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.745365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:58.745665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.747094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.755126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 559/1096] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:58.760642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.819626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbcec-23e7-479c-ad93-0c582646773f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.853835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626ae2-12d4-497c-a7c8-47cfbf327dbd None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:58.854140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.854792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.855104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.855376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.887041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:58.887909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:58.888183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:58.888453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] PATH_INFO: `/v3/users/9b92940f3d3c47c38e79f05beadbd4aa` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:58.889650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] RBAC: Authorizing `identity:get_user(user_id=9b92940f3d3c47c38e79f05beadbd4aa)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.891108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.892721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 560/1097] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/users/9b92940f3d3c47c38e79f05beadbd4aa => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:58.898532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:58.920467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:58.921996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:58.994715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b63e5-9726-4d8a-941f-ed2d045a342b None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.015467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 538/1098] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 08:03:59.021265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.029641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.030272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.030546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.030808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.096149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.097634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.114829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d244a-7531-435f-b9e1-b75461e9841a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.148599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.149374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.149653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.149920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.159644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.161068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:03:59.177857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:59.178806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:59.180035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:03:59.180035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:03:59.180035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:03:59.180035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:59.180035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 539/1099] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:03:59.184771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.189842 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 561/1100] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:03:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 08:03:59.195971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.286823 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc614b-430b-474c-8eb6-08a3b92faf63 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.287054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccf9e8-cab7-4fd9-b19c-51229a2d8a1d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.320599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.321273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.321422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.321712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.321933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.322067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.322172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.322459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.323186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] RBAC: Authorizing `identity:get_project(project_id=eca3a072fa9045f1a80bc00020472e49)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.323295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:59.323500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.324675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.324932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.326511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 562/1101] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:59.332533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.336559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 540/1102] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:59.341885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.432846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76654c-90f9-4b36-8a09-d25282a4a097 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.437801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934988b-9d13-43a8-9a3a-4b35e5cea0fe None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.467741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.468386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.468664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.468937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.469766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=eca3a072fa9045f1a80bc00020472e49, user.id=9b92940f3d3c47c38e79f05beadbd4aa) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:59.470074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.471392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.471590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.472217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.472504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.472784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.477783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 563/1103] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/role_assignments?user.id=9b92940f3d3c47c38e79f05beadbd4aa&scope.project.id=eca3a072fa9045f1a80bc00020472e49&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:03:59.479312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.480857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:03:59.495846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:03:59.496920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:03:59.497856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 541/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:03:59.503503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.612442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec96f7f-394c-4e55-ac79-8206e3b73c83 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.648930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.649590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.649868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.650141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.651624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:59.651928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.653430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec0d3-8824-4110-b21a-ac687338a237 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.666213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 564/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:03:59.672451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:03:59.773421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa36599-fc12-4e27-b1f6-59b011a09ee5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:03:59.807617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:03:59.808262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:03:59.808539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:03:59.808871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:03:59.809691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] RBAC: Adding query filter params (role.id=23e0684d61054741b4ebf0e309411f54, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=268f6afa0af84c6b9a6807975bb8db87) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:03:59.809997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:03:59.811471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617cd4-fc4e-48ee-bb53-a3f90ee11e1b None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:03:59.817648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 542/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:03:59 2022] GET /identity/v3/role_assignments?user.id=268f6afa0af84c6b9a6807975bb8db87&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=23e0684d61054741b4ebf0e309411f54 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:01.729993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827120-755e-48a9-837e-380da33e15e4 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:01.730977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827120-755e-48a9-837e-380da33e15e4 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:01.730977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827120-755e-48a9-837e-380da33e15e4 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:01.733016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 565/1107] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:01.741694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:01.742100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:01.742316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:01.768061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:01.769251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:01.859626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 543/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:01.884499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827120-755e-48a9-837e-380da33e15e4 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:01.982678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827120-755e-48a9-837e-380da33e15e4 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:02.014859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ae3a4-d667-41d9-b417-ded2fde2e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:02.015654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae3a4-d667-41d9-b417-ded2fde2e669 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:02.015928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae3a4-d667-41d9-b417-ded2fde2e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:02.016192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ae3a4-d667-41d9-b417-ded2fde2e669 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:02.017455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ae3a4-d667-41d9-b417-ded2fde2e669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:02.018909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ae3a4-d667-41d9-b417-ded2fde2e669 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:02.020473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 566/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:02.026786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:02.123489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c82e8-1976-47c6-9f56-3fd130cd80fa None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:02.158587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223729e-e42b-4e45-8800-e6d26b48e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:02.159271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223729e-e42b-4e45-8800-e6d26b48e802 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:02.159548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223729e-e42b-4e45-8800-e6d26b48e802 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:02.159813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223729e-e42b-4e45-8800-e6d26b48e802 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:02.160510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223729e-e42b-4e45-8800-e6d26b48e802 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:02.161959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223729e-e42b-4e45-8800-e6d26b48e802 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:02.183870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 544/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:04:02 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:04:04.475589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6dec-ee7b-4bf0-a877-c6172c2372d1 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:04.476442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6dec-ee7b-4bf0-a877-c6172c2372d1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:04.476442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a6dec-ee7b-4bf0-a877-c6172c2372d1 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:04.478694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 567/1111] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:04.484123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:04.484565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:04.484668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:04.503121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:04.504814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:04.577626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 545/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:04.601266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6dec-ee7b-4bf0-a877-c6172c2372d1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:04.700981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a6dec-ee7b-4bf0-a877-c6172c2372d1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:04.734817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:04.735702 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:04.735975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:04.736241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] PATH_INFO: `/v3/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:04.737823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] RBAC: Authorizing `identity:get_role(role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:04.739220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:04.740558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 568/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:04 2022] GET /identity/v3/roles/85adb51ebde647209c75f54b8c949bdc => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:04.746584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:04.849521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e22cd1-ceb9-4d00-9778-c1d10ab41669 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:04.884529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:04.885384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:04.885662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:04.885911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] PATH_INFO: `/v3/users/b4a0361fdbf1431fb111fad6ed2d497b` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:04.900600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a0361fdbf1431fb111fad6ed2d497b)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:04.902013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:04.903757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 546/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:04 2022] GET /identity/v3/users/b4a0361fdbf1431fb111fad6ed2d497b => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:04.909790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:05.022592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106403d9-3cf3-49b5-872b-49152e4a863c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:05.056131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:05.056753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:05.057030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:05.057294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:05.122993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:05.124419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:05.219656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 569/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:05.225972 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:05.328565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088318c-ee53-471d-bfdf-cc8ae4ff7546 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:05.362738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e098e8-91fd-4fac-9746-f5382b7efe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:05.363628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e098e8-91fd-4fac-9746-f5382b7efe74 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:05.363902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e098e8-91fd-4fac-9746-f5382b7efe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:05.364172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e098e8-91fd-4fac-9746-f5382b7efe74 None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:05.365472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e098e8-91fd-4fac-9746-f5382b7efe74 None admin] RBAC: Authorizing `identity:get_project(project_id=eca3a072fa9045f1a80bc00020472e49)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:05.366919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e098e8-91fd-4fac-9746-f5382b7efe74 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:05.368605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 547/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:05 2022] GET /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:05.375664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:05.489773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955c1f0-c84d-43c1-b2c6-39eb0432e717 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:05.523870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:05.524506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:05.524774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:05.525035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:05.525851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] RBAC: Adding query filter params (role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=eca3a072fa9045f1a80bc00020472e49, user.id=b4a0361fdbf1431fb111fad6ed2d497b) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:05.526138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:05.527613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5eafbf-8334-4362-9d10-25ec7d1bd8cd None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:05.533045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 570/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:04:05 2022] GET /identity/v3/role_assignments?user.id=b4a0361fdbf1431fb111fad6ed2d497b&scope.project.id=eca3a072fa9045f1a80bc00020472e49&role.id=85adb51ebde647209c75f54b8c949bdc => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:07.728982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6da8-972a-4766-99ba-755bbfe82b16 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:07.729497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6da8-972a-4766-99ba-755bbfe82b16 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:07.729497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6da8-972a-4766-99ba-755bbfe82b16 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:07.731267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 548/1118] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:07.737001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:07.737475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:07.737475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:07.762940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:07.764144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:07.832285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 571/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:04:07.857853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6da8-972a-4766-99ba-755bbfe82b16 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:07.961947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6da8-972a-4766-99ba-755bbfe82b16 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:08.002992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:08.003772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:08.004045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:08.004306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] PATH_INFO: `/v3/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:08.005879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] RBAC: Authorizing `identity:get_role(role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:08.007264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:08.008635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 549/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:07 2022] GET /identity/v3/roles/85adb51ebde647209c75f54b8c949bdc => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:08.015641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:08.124474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635a315-31cd-446d-8381-5893ba8c7858 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:08.158094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:08.158961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:08.159241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:08.159513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] PATH_INFO: `/v3/users/b4a0361fdbf1431fb111fad6ed2d497b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:08.160725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] RBAC: Authorizing `identity:get_user(user_id=b4a0361fdbf1431fb111fad6ed2d497b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:08.162160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:08.163790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 572/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:08 2022] GET /identity/v3/users/b4a0361fdbf1431fb111fad6ed2d497b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:08.169955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:08.267706 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76feef1-8955-4fe5-9060-425ade9dd89c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:08.301961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acf95-cf0a-418b-8a6c-6615d1b54427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:08.302797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acf95-cf0a-418b-8a6c-6615d1b54427 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:08.303111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acf95-cf0a-418b-8a6c-6615d1b54427 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:08.303365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acf95-cf0a-418b-8a6c-6615d1b54427 None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:08.304577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acf95-cf0a-418b-8a6c-6615d1b54427 None admin] RBAC: Authorizing `identity:get_project(project_id=eca3a072fa9045f1a80bc00020472e49)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:08.305986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acf95-cf0a-418b-8a6c-6615d1b54427 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:08.307693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 550/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:08 2022] GET /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:08.313737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:08.439180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409737e8-9802-4899-a2a4-09c8531aec4f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:08.474007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd36e9-9a7f-488e-8099-101b381f2f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:08.474917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd36e9-9a7f-488e-8099-101b381f2f56 None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:08.475190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd36e9-9a7f-488e-8099-101b381f2f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:08.475462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd36e9-9a7f-488e-8099-101b381f2f56 None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49/users/b4a0361fdbf1431fb111fad6ed2d497b/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:08.478058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd36e9-9a7f-488e-8099-101b381f2f56 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3a072fa9045f1a80bc00020472e49, user_id=b4a0361fdbf1431fb111fad6ed2d497b, role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:08.479540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd36e9-9a7f-488e-8099-101b381f2f56 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:08.495050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 573/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:04:08 2022] PUT /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49/users/b4a0361fdbf1431fb111fad6ed2d497b/roles/85adb51ebde647209c75f54b8c949bdc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:04:10.726958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6c4b-2558-4026-b233-dde1176b078a None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:10.727798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6c4b-2558-4026-b233-dde1176b078a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:10.727798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6c4b-2558-4026-b233-dde1176b078a None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:10.729889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 551/1124] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:10.735440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:10.735883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:10.735982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:10.753082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:10.754245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:10.820803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 574/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:10.846286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6c4b-2558-4026-b233-dde1176b078a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:10.943299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6c4b-2558-4026-b233-dde1176b078a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:10.976771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:10.977664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:10.977905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:10.978165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] PATH_INFO: `/v3/roles/85adb51ebde647209c75f54b8c949bdc` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:10.979801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] RBAC: Authorizing `identity:get_role(role_id=85adb51ebde647209c75f54b8c949bdc)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:10.981192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:10.982512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 552/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:10 2022] GET /identity/v3/roles/85adb51ebde647209c75f54b8c949bdc => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:10.988351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:11.091666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2bbef-cc6f-4310-85f4-b8274e4c8a0a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:11.130620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:11.131563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:11.131841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:11.132135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] PATH_INFO: `/v3/users/b4a0361fdbf1431fb111fad6ed2d497b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:11.133453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] RBAC: Authorizing `identity:get_user(user_id=b4a0361fdbf1431fb111fad6ed2d497b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:11.134913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:11.136694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 575/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:10 2022] GET /identity/v3/users/b4a0361fdbf1431fb111fad6ed2d497b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:11.142990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:11.240600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0592f-d93e-498e-b0c3-516e68dc115f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:11.274383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:11.275048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:11.275326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:11.275590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:11.344549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:11.345980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:11.463297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 553/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:11.470594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:11.573357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6570623-01b5-4e76-ab8a-09651f6cb137 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:11.606827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f24f5-7c5a-40f1-8844-74ab0a232841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:11.607703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f24f5-7c5a-40f1-8844-74ab0a232841 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:11.607980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f24f5-7c5a-40f1-8844-74ab0a232841 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:11.608244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f24f5-7c5a-40f1-8844-74ab0a232841 None admin] PATH_INFO: `/v3/projects/eca3a072fa9045f1a80bc00020472e49` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:11.609596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f24f5-7c5a-40f1-8844-74ab0a232841 None admin] RBAC: Authorizing `identity:get_project(project_id=eca3a072fa9045f1a80bc00020472e49)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:11.611058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f24f5-7c5a-40f1-8844-74ab0a232841 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:11.612718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 576/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:11 2022] GET /identity/v3/projects/eca3a072fa9045f1a80bc00020472e49 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:11.619310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:11.719472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff6afc-cf9f-4b50-910e-a8cf88f4ec39 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:11.752857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:11.753470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:11.753722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:11.754011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:11.754815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] RBAC: Adding query filter params (role.id=85adb51ebde647209c75f54b8c949bdc, scope.project.id=eca3a072fa9045f1a80bc00020472e49, user.id=b4a0361fdbf1431fb111fad6ed2d497b) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:11.755222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:11.756643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a22aa9-4233-4c3a-a75b-beced702281e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:11.762287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 554/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:04:11 2022] GET /identity/v3/role_assignments?user.id=b4a0361fdbf1431fb111fad6ed2d497b&scope.project.id=eca3a072fa9045f1a80bc00020472e49&role.id=85adb51ebde647209c75f54b8c949bdc => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:13.979420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9605a-7aef-4b5d-8fe3-32ecd69a1561 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:13.980305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9605a-7aef-4b5d-8fe3-32ecd69a1561 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:13.980305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9605a-7aef-4b5d-8fe3-32ecd69a1561 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:13.982445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 577/1131] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:13.991159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:13.991578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:13.991754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:14.011023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:14.012295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:14.079251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 555/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:14.106687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9605a-7aef-4b5d-8fe3-32ecd69a1561 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:14.210535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9605a-7aef-4b5d-8fe3-32ecd69a1561 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:14.244321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3eb1e-c032-4f4a-be3d-ef1c91501445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:14.245026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3eb1e-c032-4f4a-be3d-ef1c91501445 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:14.245330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3eb1e-c032-4f4a-be3d-ef1c91501445 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:14.245597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3eb1e-c032-4f4a-be3d-ef1c91501445 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:14.246830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3eb1e-c032-4f4a-be3d-ef1c91501445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:14.248305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3eb1e-c032-4f4a-be3d-ef1c91501445 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:14.249884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 578/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:04:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:14.255907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:14.364029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308e0da-7cc3-4446-a13c-53c60c2770c9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:14.398376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e9fd9-2872-44ed-87a8-0dbccf3a5ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:14.399056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9fd9-2872-44ed-87a8-0dbccf3a5ec8 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:14.399345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9fd9-2872-44ed-87a8-0dbccf3a5ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:14.399587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e9fd9-2872-44ed-87a8-0dbccf3a5ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:14.400283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e9fd9-2872-44ed-87a8-0dbccf3a5ec8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:14.401703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e9fd9-2872-44ed-87a8-0dbccf3a5ec8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:14.429090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 556/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:04:14 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:04:16.658295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f026cc-a610-4140-9397-4027fcf04854 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:16.659197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f026cc-a610-4140-9397-4027fcf04854 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:16.659197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f026cc-a610-4140-9397-4027fcf04854 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:16.661374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 579/1135] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:16.666681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:16.667134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:16.667240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:16.685246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:16.686408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:16.755013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 557/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:16.780042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f026cc-a610-4140-9397-4027fcf04854 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:16.884596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f026cc-a610-4140-9397-4027fcf04854 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:16.918424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33fb84-2e48-4e50-b8f1-5dfd4b2eb429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:16.919138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fb84-2e48-4e50-b8f1-5dfd4b2eb429 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:16.919419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fb84-2e48-4e50-b8f1-5dfd4b2eb429 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:16.919683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33fb84-2e48-4e50-b8f1-5dfd4b2eb429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:16.920966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33fb84-2e48-4e50-b8f1-5dfd4b2eb429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:16.922396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33fb84-2e48-4e50-b8f1-5dfd4b2eb429 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:16.924003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 580/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:16.929870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:17.038342 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48a33-55dd-4adb-8188-ebe06e95d6c0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:17.080398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41438a-4c01-4655-b1fa-04921eda91ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:17.081329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41438a-4c01-4655-b1fa-04921eda91ec None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:17.081678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41438a-4c01-4655-b1fa-04921eda91ec None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:17.082049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41438a-4c01-4655-b1fa-04921eda91ec None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:17.083200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41438a-4c01-4655-b1fa-04921eda91ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:17.085463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41438a-4c01-4655-b1fa-04921eda91ec None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:17.110968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 558/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:04:16 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:04:19.370179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c9cd5-ab10-4c1a-90de-91743d297e0d None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:19.370794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c9cd5-ab10-4c1a-90de-91743d297e0d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:19.370794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c9cd5-ab10-4c1a-90de-91743d297e0d None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:19.372845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 581/1139] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:19.381267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:19.381672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:19.381880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:19.405548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:19.406724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:19.479465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 559/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:19.517643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c9cd5-ab10-4c1a-90de-91743d297e0d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:19.628737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c9cd5-ab10-4c1a-90de-91743d297e0d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:19.662512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:19.663330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:19.663608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:19.663889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:19.674139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:04:19.682082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:19.683363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:04:19.684634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 582/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:19.689968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:19.787488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817a1d7-6357-494b-8ab8-8d1be6fea81a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:19.823960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:19.824602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:19.824872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:19.825136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:19.825874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:19.826180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:19.827560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:19.835443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 560/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:19.843494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:19.958849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644fff3-77aa-4a0d-b7fa-72b89be77867 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:19.991511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:19.992364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:19.992635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:19.992887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] PATH_INFO: `/v3/users/b1ed83639b1b46e593e8aa0a554d68a5` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:20.005837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] RBAC: Authorizing `identity:get_user(user_id=b1ed83639b1b46e593e8aa0a554d68a5)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:20.007287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:20.008903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 583/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:19 2022] GET /identity/v3/users/b1ed83639b1b46e593e8aa0a554d68a5 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:20.017288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:20.117919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9fdf4-07d9-472a-bcd0-ed5bb3b85620 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:20.150921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:20.151561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:20.151890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:20.152150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:20.224738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:20.226098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:20.324231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 561/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:20.330294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:20.432956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d053d2-dd7d-4473-a8de-9a7047aefe7e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:20.468657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51917958-014e-4647-a64d-e4fc87d2f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:20.469532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51917958-014e-4647-a64d-e4fc87d2f297 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:20.469812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51917958-014e-4647-a64d-e4fc87d2f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:20.470077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51917958-014e-4647-a64d-e4fc87d2f297 None admin] PATH_INFO: `/v3/projects/01426db7b43445bdbceb3a70b230e1e3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:20.471306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51917958-014e-4647-a64d-e4fc87d2f297 None admin] RBAC: Authorizing `identity:get_project(project_id=01426db7b43445bdbceb3a70b230e1e3)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:20.472745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51917958-014e-4647-a64d-e4fc87d2f297 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:20.474460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 584/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:20 2022] GET /identity/v3/projects/01426db7b43445bdbceb3a70b230e1e3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:20.481029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:20.574726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd59419-b3eb-45fd-8eba-4717e7047929 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:20.608603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:20.609236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:20.609513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:20.609783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:20.610592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=01426db7b43445bdbceb3a70b230e1e3, user.id=b1ed83639b1b46e593e8aa0a554d68a5) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:20.610925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:20.612332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c630a-8f90-492c-80f2-17abbfa4b4e2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:20.617731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 562/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:04:20 2022] GET /identity/v3/role_assignments?user.id=b1ed83639b1b46e593e8aa0a554d68a5&scope.project.id=01426db7b43445bdbceb3a70b230e1e3&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:22.844292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45840fd3-101c-4223-92fa-6dc658b08498 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:22.844808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45840fd3-101c-4223-92fa-6dc658b08498 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:22.844808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45840fd3-101c-4223-92fa-6dc658b08498 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:22.846865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 585/1147] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:22.855755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:22.856161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:22.856344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:22.882753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:22.884554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:22.959427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 563/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:22.982325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45840fd3-101c-4223-92fa-6dc658b08498 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:23.109728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45840fd3-101c-4223-92fa-6dc658b08498 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:23.147775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:23.148554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:23.148830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:23.149092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:23.159734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:04:23.167271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:23.168363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:04:23.169704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 586/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:23.178377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:23.294551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0b318-50d7-42e6-93f2-c4e65713f833 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:23.330768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:23.331470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:23.331745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:23.332014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:23.332750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:23.333048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:23.334406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:23.342335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 564/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:04:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:23.349287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:23.451649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7f65-6f39-43a8-a383-2691e4760ba8 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:23.486922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:23.487804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:23.488084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:23.488354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] PATH_INFO: `/v3/users/b1ed83639b1b46e593e8aa0a554d68a5` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:23.489669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ed83639b1b46e593e8aa0a554d68a5)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:23.491130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:23.492762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 587/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:23 2022] GET /identity/v3/users/b1ed83639b1b46e593e8aa0a554d68a5 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:23.501477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:23.610998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007b92-d8fe-47b5-96e0-94a1363f002d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:23.653567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345b2c-fdcf-4e2f-b67f-367eb8925eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:23.654429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345b2c-fdcf-4e2f-b67f-367eb8925eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:23.654706 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345b2c-fdcf-4e2f-b67f-367eb8925eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:23.655002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345b2c-fdcf-4e2f-b67f-367eb8925eb2 None admin] PATH_INFO: `/v3/projects/01426db7b43445bdbceb3a70b230e1e3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:23.656369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345b2c-fdcf-4e2f-b67f-367eb8925eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=01426db7b43445bdbceb3a70b230e1e3)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:23.657758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345b2c-fdcf-4e2f-b67f-367eb8925eb2 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:23.659467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 565/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:23 2022] GET /identity/v3/projects/01426db7b43445bdbceb3a70b230e1e3 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:23.665514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:23.774784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ca55-3641-4f94-aa38-87fa9ff58917 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:23.817116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace24d91-a02c-40d2-9510-c3cbdb14ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:23.818383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24d91-a02c-40d2-9510-c3cbdb14ce8c None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:23.818726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24d91-a02c-40d2-9510-c3cbdb14ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:23.819155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24d91-a02c-40d2-9510-c3cbdb14ce8c None admin] PATH_INFO: `/v3/projects/01426db7b43445bdbceb3a70b230e1e3/users/b1ed83639b1b46e593e8aa0a554d68a5/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:23.822421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24d91-a02c-40d2-9510-c3cbdb14ce8c None admin] RBAC: Authorizing `identity:create_grant(project_id=01426db7b43445bdbceb3a70b230e1e3, user_id=b1ed83639b1b46e593e8aa0a554d68a5, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:23.824709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24d91-a02c-40d2-9510-c3cbdb14ce8c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:23.843771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 588/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:04:23 2022] PUT /identity/v3/projects/01426db7b43445bdbceb3a70b230e1e3/users/b1ed83639b1b46e593e8aa0a554d68a5/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:04:26.036967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550bd7-2f0d-4144-aa1f-6a23c146c4ac None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:26.037553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550bd7-2f0d-4144-aa1f-6a23c146c4ac None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:26.037553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e550bd7-2f0d-4144-aa1f-6a23c146c4ac None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:26.038853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 566/1154] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:26.045331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:26.046054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:26.046255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:26.068694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:26.069860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:26.137214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 589/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:26.166468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550bd7-2f0d-4144-aa1f-6a23c146c4ac None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:26.275808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e550bd7-2f0d-4144-aa1f-6a23c146c4ac None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:26.310936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:26.311654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:26.311933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:26.312207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:26.323261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:04:26.330982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:26.332079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:04:26.333102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 567/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:04:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:26.338196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:26.441061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73f05-509e-4306-9571-41acdbd63704 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:26.482542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:26.483234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:26.483508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:26.483776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:26.484518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:26.484815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:26.486190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:26.494612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 590/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:04:26.500567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:26.609818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74a50-65bb-4c44-8108-256d78458114 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:26.643623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:26.644471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:26.644751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:26.644994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] PATH_INFO: `/v3/users/b1ed83639b1b46e593e8aa0a554d68a5` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:26.646318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] RBAC: Authorizing `identity:get_user(user_id=b1ed83639b1b46e593e8aa0a554d68a5)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:26.647775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:26.649364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 568/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:26 2022] GET /identity/v3/users/b1ed83639b1b46e593e8aa0a554d68a5 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:26.655943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:26.761672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58b209-39a5-4009-8c5a-8e51d758911f None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:26.805632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:26.806582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:26.807095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:26.807489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:26.877129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:26.878501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:26.982899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 591/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:26.989161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:27.088148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ef0e9-5247-4aea-a49b-b3b02b563430 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:27.125126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e814c2-a245-4609-ae76-f668a38824fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:27.125976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e814c2-a245-4609-ae76-f668a38824fd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:27.126255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e814c2-a245-4609-ae76-f668a38824fd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:27.126526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e814c2-a245-4609-ae76-f668a38824fd None admin] PATH_INFO: `/v3/projects/01426db7b43445bdbceb3a70b230e1e3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:27.127851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e814c2-a245-4609-ae76-f668a38824fd None admin] RBAC: Authorizing `identity:get_project(project_id=01426db7b43445bdbceb3a70b230e1e3)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:27.129224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e814c2-a245-4609-ae76-f668a38824fd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:27.131222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 569/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:26 2022] GET /identity/v3/projects/01426db7b43445bdbceb3a70b230e1e3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:27.139324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:27.244405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c3469-6918-4c82-953a-876b8500eac6 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:27.286281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:27.286926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:27.287223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:27.287492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:27.288311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=01426db7b43445bdbceb3a70b230e1e3, user.id=b1ed83639b1b46e593e8aa0a554d68a5) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:27.288613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:27.290054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a510f6-6a7d-4ded-917a-73023f948315 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:27.296070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 592/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:04:27 2022] GET /identity/v3/role_assignments?user.id=b1ed83639b1b46e593e8aa0a554d68a5&scope.project.id=01426db7b43445bdbceb3a70b230e1e3&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:29.508269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5ebc-d8d2-4d3d-ba6f-af2b218ca948 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:29.509056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5ebc-d8d2-4d3d-ba6f-af2b218ca948 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:29.509173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5ebc-d8d2-4d3d-ba6f-af2b218ca948 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:29.511298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 570/1162] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:29.516680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:29.517121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:29.517213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:29.534394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:29.535582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:29.602111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 593/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:29.625271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5ebc-d8d2-4d3d-ba6f-af2b218ca948 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:29.737926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5ebc-d8d2-4d3d-ba6f-af2b218ca948 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:29.771362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:29.771992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:29.772264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:29.772526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:29.837773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:29.839292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:29.935474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 571/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:29.945774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:30.066762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67de60b-d3cc-4532-a0da-427a60aae0a9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:30.101552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:30.102347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:30.102623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:30.102921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:30.109938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:30.111427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-7a27e7e4-fd9f-4a3d-9e72-03cfff642bf8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:30.125501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:30.126713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:04:30.127656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 594/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:04:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:30.134352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:30.235536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c95f3-2b27-4fd2-9811-77b508608bdd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:30.283176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:30.283834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:30.284116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:30.284387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:30.285107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:30.285410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:30.286768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9a1a-0220-409e-ad44-d701afb7b74a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:30.294506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 572/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Wed May 4 08:04:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:04:32.485246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa46cca-1a08-405c-af94-d49be713c4aa None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:32.485996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa46cca-1a08-405c-af94-d49be713c4aa None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:32.485996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa46cca-1a08-405c-af94-d49be713c4aa None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:32.487789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 595/1167] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:32.493662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5723ba-8ae9-4726-bc86-30757f732e92 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:32.494117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5723ba-8ae9-4726-bc86-30757f732e92 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:32.494209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5723ba-8ae9-4726-bc86-30757f732e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:32.515009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-bf5723ba-8ae9-4726-bc86-30757f732e92 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:32.516200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bf5723ba-8ae9-4726-bc86-30757f732e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:32.582683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 573/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:04:32.606268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa46cca-1a08-405c-af94-d49be713c4aa None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:32.711795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa46cca-1a08-405c-af94-d49be713c4aa None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:32.753663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7536-3751-46fe-a98f-0ea3aba88203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:32.754300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7536-3751-46fe-a98f-0ea3aba88203 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:32.754575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7536-3751-46fe-a98f-0ea3aba88203 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:32.754847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7536-3751-46fe-a98f-0ea3aba88203 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:32.755618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7536-3751-46fe-a98f-0ea3aba88203 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:32.757011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7536-3751-46fe-a98f-0ea3aba88203 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:32.777737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 596/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Wed May 4 08:04:32 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:04:35.033071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242144-5abe-4ddc-870d-bf44ebcf425f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:35.033997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242144-5abe-4ddc-870d-bf44ebcf425f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:35.033997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa242144-5abe-4ddc-870d-bf44ebcf425f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:35.036135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 574/1170] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:35.044694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:35.045138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:35.045265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:35.067700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:35.068880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:35.137561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 597/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:35.166141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242144-5abe-4ddc-870d-bf44ebcf425f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:35.277756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa242144-5abe-4ddc-870d-bf44ebcf425f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:35.313373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35824a-d29e-4174-b297-231e6d720c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:35.314151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35824a-d29e-4174-b297-231e6d720c4f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:35.314429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35824a-d29e-4174-b297-231e6d720c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:35.314694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35824a-d29e-4174-b297-231e6d720c4f None admin] PATH_INFO: `/v3/domains/fe4645e4d39d4159afa4bb4bd34a7523` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:35.325765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35824a-d29e-4174-b297-231e6d720c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe4645e4d39d4159afa4bb4bd34a7523)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:35.327230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35824a-d29e-4174-b297-231e6d720c4f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:35.328827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 575/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Wed May 4 08:04:35 2022] GET /identity/v3/domains/fe4645e4d39d4159afa4bb4bd34a7523 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:35.337443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:35.445649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17c078-b9f5-4320-b70e-ce9e9c81d300 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:35.480798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a444c-18bb-48dc-b9bc-a568c4d4593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:35.481447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a444c-18bb-48dc-b9bc-a568c4d4593a None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:35.481722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a444c-18bb-48dc-b9bc-a568c4d4593a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:35.481988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a444c-18bb-48dc-b9bc-a568c4d4593a None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:35.482683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a444c-18bb-48dc-b9bc-a568c4d4593a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:35.484164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a444c-18bb-48dc-b9bc-a568c4d4593a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:35.511301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 598/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:04:35 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:04:37.742370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf158abe-e773-4766-a978-a456f5f303e7 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:37.743257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf158abe-e773-4766-a978-a456f5f303e7 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:37.743257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf158abe-e773-4766-a978-a456f5f303e7 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:37.745499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 576/1174] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:37.751789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:37.752241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:37.752339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:37.772436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:37.773606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:37.843367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 599/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:37.878735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf158abe-e773-4766-a978-a456f5f303e7 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:37.982204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf158abe-e773-4766-a978-a456f5f303e7 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:38.016156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d273975-0242-4e7a-a928-4a1d77aec21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:38.016940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d273975-0242-4e7a-a928-4a1d77aec21e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:38.017221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d273975-0242-4e7a-a928-4a1d77aec21e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:38.017487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d273975-0242-4e7a-a928-4a1d77aec21e None admin] PATH_INFO: `/v3/domains/fe4645e4d39d4159afa4bb4bd34a7523` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:38.018774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d273975-0242-4e7a-a928-4a1d77aec21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe4645e4d39d4159afa4bb4bd34a7523)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:38.020245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d273975-0242-4e7a-a928-4a1d77aec21e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:38.021838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 577/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Wed May 4 08:04:37 2022] GET /identity/v3/domains/fe4645e4d39d4159afa4bb4bd34a7523 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:38.027997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:38.134610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803ced-eb9d-45a6-b5ec-bdb4297b15cf None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:38.168896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d54311-665e-437b-b11e-77b6757f3591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:38.169544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d54311-665e-437b-b11e-77b6757f3591 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:38.169820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d54311-665e-437b-b11e-77b6757f3591 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:38.170091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d54311-665e-437b-b11e-77b6757f3591 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:38.170781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d54311-665e-437b-b11e-77b6757f3591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:38.172241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d54311-665e-437b-b11e-77b6757f3591 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:38.194862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 600/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:04:38 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:04:40.453271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4817-5307-44ae-b82a-e411c9455d8f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:40.454075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4817-5307-44ae-b82a-e411c9455d8f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:40.454075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c4817-5307-44ae-b82a-e411c9455d8f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:40.456397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 578/1178] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:40.462744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:40.463215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:40.463356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:40.487190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:40.488355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:40.562103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 601/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:40.590751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c4817-5307-44ae-b82a-e411c9455d8f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:40.707541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c4817-5307-44ae-b82a-e411c9455d8f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:40.744214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:40.745018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:40.745295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:40.745565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:40.756190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:04:40.763822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:40.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:04:40.766852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 579/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:40.774726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:40.878275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa5d60-ec20-4495-a7ab-936b5219df0a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:40.919495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:40.920152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:40.920429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:40.920697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:40.921443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:40.921742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:40.923131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:40.931247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 602/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:40.937697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:41.049320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae4a5-b230-4645-95d2-2f32a53ea2b9 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:41.083969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:41.084822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:41.085099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:41.085377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] PATH_INFO: `/v3/users/8431deb95e1347b086adb3409d1821fa` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:41.099121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] RBAC: Authorizing `identity:get_user(user_id=8431deb95e1347b086adb3409d1821fa)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:41.100550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:41.102170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 580/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:40 2022] GET /identity/v3/users/8431deb95e1347b086adb3409d1821fa => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:41.111000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:41.213649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ece78c-0d92-4b8d-b407-3c085afacdf1 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:41.247550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:41.248270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:41.248543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:41.248851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:41.314911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:41.316628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:41.417551 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 603/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:41.423745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:41.519897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dd3f7-506f-4855-ae5f-e23d7e07b2ed None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:41.555923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388921df-4387-4105-9bd4-ac24a6aca3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:41.556755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388921df-4387-4105-9bd4-ac24a6aca3ff None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:41.557026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388921df-4387-4105-9bd4-ac24a6aca3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:41.557376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388921df-4387-4105-9bd4-ac24a6aca3ff None admin] PATH_INFO: `/v3/projects/ce174527fa224134a6bd4e91643967a8` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:41.558648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388921df-4387-4105-9bd4-ac24a6aca3ff None admin] RBAC: Authorizing `identity:get_project(project_id=ce174527fa224134a6bd4e91643967a8)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:41.560095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388921df-4387-4105-9bd4-ac24a6aca3ff None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:41.561735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 581/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:41 2022] GET /identity/v3/projects/ce174527fa224134a6bd4e91643967a8 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:41.568434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:41.670377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223aabc-e2da-4f82-9250-dd235dcf214d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:41.706635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:41.707329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:41.707606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:41.707853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:41.708690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=ce174527fa224134a6bd4e91643967a8, user.id=8431deb95e1347b086adb3409d1821fa) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:41.708992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:41.710427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133ba9b-0222-40ce-9fc8-8f3510d00f1d None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:41.716287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 604/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:04:41 2022] GET /identity/v3/role_assignments?user.id=8431deb95e1347b086adb3409d1821fa&scope.project.id=ce174527fa224134a6bd4e91643967a8&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:43.903441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb682225-9c28-4ae7-87b8-7919e1445b1d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:43.904274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb682225-9c28-4ae7-87b8-7919e1445b1d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:43.904274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb682225-9c28-4ae7-87b8-7919e1445b1d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:43.906447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 582/1186] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:43.912896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:43.913646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:43.913769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:43.938458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:43.939671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:44.010929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 605/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:44.039447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb682225-9c28-4ae7-87b8-7919e1445b1d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:44.149267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb682225-9c28-4ae7-87b8-7919e1445b1d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:44.189217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:44.190293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:44.190750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:44.191530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:44.204918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:04:44.212406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:44.213538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:04:44.214428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 583/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:44.219797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:44.332917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bcfa7-5369-43e0-8a78-c2c2c0f844ce None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:44.366290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:44.366942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:44.367246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:44.367514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:44.368251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:44.368553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:44.369966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:44.378721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 606/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:44.386402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:44.492017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24e5c5-2a3e-459d-ab98-f5522bd5c308 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:44.525736 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:44.526614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:44.526921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:44.527181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] PATH_INFO: `/v3/users/8431deb95e1347b086adb3409d1821fa` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:44.528498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=8431deb95e1347b086adb3409d1821fa)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:44.529928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:44.531574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 584/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:44 2022] GET /identity/v3/users/8431deb95e1347b086adb3409d1821fa => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:44.541752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:44.641019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1caa43-4265-4e20-8695-bdebdbf9e039 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:44.677218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953876-aea5-457f-8a35-4494e75e3ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:44.678050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953876-aea5-457f-8a35-4494e75e3ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:44.678320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953876-aea5-457f-8a35-4494e75e3ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:44.678585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953876-aea5-457f-8a35-4494e75e3ee7 None admin] PATH_INFO: `/v3/projects/ce174527fa224134a6bd4e91643967a8` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:44.679810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02953876-aea5-457f-8a35-4494e75e3ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=ce174527fa224134a6bd4e91643967a8)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:44.681222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02953876-aea5-457f-8a35-4494e75e3ee7 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:44.682972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 607/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:44 2022] GET /identity/v3/projects/ce174527fa224134a6bd4e91643967a8 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:44.692551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:44.800572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500897f-182e-483a-af7f-a94954fd7fd7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:44.845682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79784c4a-bb58-4bb5-a1de-fc5698eefd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:44.846545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784c4a-bb58-4bb5-a1de-fc5698eefd79 None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:44.846819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784c4a-bb58-4bb5-a1de-fc5698eefd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:44.847112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784c4a-bb58-4bb5-a1de-fc5698eefd79 None admin] PATH_INFO: `/v3/projects/ce174527fa224134a6bd4e91643967a8/users/8431deb95e1347b086adb3409d1821fa/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:44.849153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79784c4a-bb58-4bb5-a1de-fc5698eefd79 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce174527fa224134a6bd4e91643967a8, user_id=8431deb95e1347b086adb3409d1821fa, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:44.850556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79784c4a-bb58-4bb5-a1de-fc5698eefd79 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:44.868726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 585/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:04:44 2022] PUT /identity/v3/projects/ce174527fa224134a6bd4e91643967a8/users/8431deb95e1347b086adb3409d1821fa/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:04:47.072672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071374-8dd5-4529-a54a-31508d95e7f7 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:47.073248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071374-8dd5-4529-a54a-31508d95e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:47.073248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84071374-8dd5-4529-a54a-31508d95e7f7 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:47.074606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 608/1193] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:04:47.081366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:47.082047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:47.082232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:47.103412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:04:47.104845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:04:47.174802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 586/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:04:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:04:47.207991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071374-8dd5-4529-a54a-31508d95e7f7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:47.333093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84071374-8dd5-4529-a54a-31508d95e7f7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:47.366479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:47.367286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:47.367544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:47.367809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:47.377857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:04:47.385308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:04:47.386300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:04:47.387249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 609/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:04:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:04:47.393313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:47.499407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270b5a-66aa-48f5-bfcf-2234d02ac8b1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:47.536681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:47.537334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:47.537618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:47.537888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:47.538632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:47.538953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:47.540312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:47.548230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 587/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:04:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:47.554305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:47.659977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abf04-e794-4d16-ac2a-9fc4feab84b4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:47.695181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:47.696027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:47.696303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:47.696575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] PATH_INFO: `/v3/users/8431deb95e1347b086adb3409d1821fa` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:47.697893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] RBAC: Authorizing `identity:get_user(user_id=8431deb95e1347b086adb3409d1821fa)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:47.699347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:47.700938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 610/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Wed May 4 08:04:47 2022] GET /identity/v3/users/8431deb95e1347b086adb3409d1821fa => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:47.710254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:47.825070 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ff661-c504-4e3a-8ad5-8a3d50647ec7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:47.858671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:47.859328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:47.859605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:47.859868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:47.925304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:47.926703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:48.020927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 588/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:04:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:04:48.027315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:48.153401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7496-92e1-4ce4-88d1-d2faa69bdfbe None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:48.197675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc6a2-cccd-4b8d-b340-79193472fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:48.198437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc6a2-cccd-4b8d-b340-79193472fd4f None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:48.198743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc6a2-cccd-4b8d-b340-79193472fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:48.199078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc6a2-cccd-4b8d-b340-79193472fd4f None admin] PATH_INFO: `/v3/projects/ce174527fa224134a6bd4e91643967a8` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:48.200380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc6a2-cccd-4b8d-b340-79193472fd4f None admin] RBAC: Authorizing `identity:get_project(project_id=ce174527fa224134a6bd4e91643967a8)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:48.201815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc6a2-cccd-4b8d-b340-79193472fd4f None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:48.203536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 611/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Wed May 4 08:04:48 2022] GET /identity/v3/projects/ce174527fa224134a6bd4e91643967a8 => generated 361 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:04:48.210387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:04:48.314014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0616c05-bdc5-4c19-b55d-d716ae695393 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:04:48.348328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:04:48.348962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:04:48.349237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:04:48.349508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:04:48.350322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=ce174527fa224134a6bd4e91643967a8, user.id=8431deb95e1347b086adb3409d1821fa) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:04:48.350624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:04:48.352076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf90a78-a17e-4e8b-9606-eeee9209e85a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:04:48.357880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 589/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:04:48 2022] GET /identity/v3/role_assignments?user.id=8431deb95e1347b086adb3409d1821fa&scope.project.id=ce174527fa224134a6bd4e91643967a8&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:49.351421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c567b-05a9-4628-8515-a0246f7c3677 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:49.352106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c567b-05a9-4628-8515-a0246f7c3677 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:49.352106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c567b-05a9-4628-8515-a0246f7c3677 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:49.353911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 612/1201] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:05:49.360165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:49.360691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:49.360801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:49.380684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:05:49.382059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:05:49.479645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 590/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:05:49.505686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c567b-05a9-4628-8515-a0246f7c3677 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:49.625194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c567b-05a9-4628-8515-a0246f7c3677 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:49.663371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:49.664547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:49.664828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:49.665091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:49.676316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:49.677778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:05:49.700922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:49.702060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:49.703117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:05:49.703117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:05:49.703117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:49.703117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:05:49.703117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 613/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:49.709018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:49.833435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cee98c-a2f0-4ad6-9bc8-0273d6b0d1d8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:49.887906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:49.888627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:49.888908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:49.889205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:49.890171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:49.890474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:49.892010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1cfb7-71ad-4a37-ba5b-6cfdf0cb4611 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:49.905025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 591/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:49.911109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:50.037480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fe322-f044-4d26-bb3e-96951cd0ecdd None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:50.084767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d4e4-43f9-4727-8929-22a3ffc86d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:50.085655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d4e4-43f9-4727-8929-22a3ffc86d60 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:50.085975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d4e4-43f9-4727-8929-22a3ffc86d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:50.086300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d4e4-43f9-4727-8929-22a3ffc86d60 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:50.087256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d4e4-43f9-4727-8929-22a3ffc86d60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:50.088810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d4e4-43f9-4727-8929-22a3ffc86d60 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:50.120610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 614/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Wed May 4 08:05:49 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:05:52.600344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38519bf-f249-4088-9899-b4a02fcddc4d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:52.600925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38519bf-f249-4088-9899-b4a02fcddc4d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:52.600925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38519bf-f249-4088-9899-b4a02fcddc4d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:52.602320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 592/1206] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:05:52.609001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:52.609609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:52.609737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:52.628857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:05:52.630135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:05:52.710983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 615/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:05:52.736261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38519bf-f249-4088-9899-b4a02fcddc4d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:52.863834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38519bf-f249-4088-9899-b4a02fcddc4d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:52.902277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:52.903209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:52.905325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:52.905325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:52.917024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:05:52.930805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:52.932093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:52.938061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 593/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:05:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:52.940870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:53.049778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50af31-e5d3-45a4-ba51-ed23cb9dce93 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:53.087286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:53.088728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:53.088728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:53.088899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:53.089698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:53.090052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:53.091644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:53.101454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 616/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:05:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:53.107609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:53.226781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71699dc-2b9b-4dc6-9e78-7e809dfa6773 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:53.266364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:53.267295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:53.267841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:53.267936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:53.281013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:53.282569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:05:53.301133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:53.302335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:53.303381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:05:53.303381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:05:53.303381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:53.303381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:53.303381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 594/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:53.308795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:53.420913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38e1c8-e57b-4553-86fa-c5f32175b38e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:53.458458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:53.459212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:53.460602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:53.460602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:53.460602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:53.461065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:53.462360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:53.475146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 617/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:53.480740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:53.594380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3314b-a8f3-446c-8a12-1ffa69ee54af None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:53.631809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:53.632619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:53.632925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:53.633192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:53.641933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:53.644151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:05:53.660423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:53.662359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 08:05:53.664806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:53.667515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:53.668189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 595/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:53.778194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc9638-b109-4dc3-b353-297fea695a53 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:53.817353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:53.820171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:53.820171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:53.820171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:53.820171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:53.820171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:53.821265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:53.846980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 618/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 4 08:05:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:53.848561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:53.957272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc257c95-b754-4e64-995e-ccb92bb29ae1 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:53.995728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:53.996427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:53.996709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:53.996980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:54.070065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:54.071705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:54.173066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 596/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:05:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 08:05:54.178826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:54.278217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcabd78-87eb-4fc2-94dd-42a211c67a13 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:54.312913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:54.313776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:54.314048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:54.314320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:54.325345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:54.326785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:05:54.344734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:54.345876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:54.354639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:05:54.354639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:05:54.354639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:54.354639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:05:54.354639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 619/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:54.355240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:54.465672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f0218-feb4-42b3-b3a8-643827a23063 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:54.500101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:54.501003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:54.501418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:54.501823 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:54.502704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:54.503173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:54.504706 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:54.516321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 597/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:54.522255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:54.625443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd2f0-d33d-4649-baf3-a5a50ad61653 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:54.670559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:54.671591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:54.671948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:54.672342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:54.680474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:54.681224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:05:54.696179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:54.697281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:05:54.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 620/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:54.703420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:54.811114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a94932-da6f-4e0b-81e4-462be117fa3f None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:54.849208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:54.850189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:54.850585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:54.851065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:54.851908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:54.852283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:54.853886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66764-382d-4fff-b4c6-c4e2b41d367e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:54.866714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 598/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:54.872983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:54.980511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d801f41-2e50-4d96-ad9e-53fc34313439 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:55.015085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:55.015816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:55.016099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:55.016408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:55.017288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=89b99e7835d04098ad38e4eee401ea91) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:55.017603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:55.019302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9505f0-e8a2-42de-bc35-49f8451d8d5a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:55.026932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 621/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:05:54 2022] GET /identity/v3/role_assignments?user.id=89b99e7835d04098ad38e4eee401ea91&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:57.368231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5d20-960a-47c3-828c-41fd50e8fe95 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:57.368860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5d20-960a-47c3-828c-41fd50e8fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:57.368860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5d20-960a-47c3-828c-41fd50e8fe95 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:57.370929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 599/1220] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:05:57.376389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:57.376883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:57.377135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:57.395694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:05:57.396877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:05:57.470273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 622/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:05:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:05:57.495939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5d20-960a-47c3-828c-41fd50e8fe95 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:57.606449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5d20-960a-47c3-828c-41fd50e8fe95 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:57.644789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:57.645653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:57.645967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:57.646235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:57.660776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:05:57.669754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:57.670908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:57.671794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 600/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:05:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:57.677963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:57.786547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c487fc-6463-46f2-b0b0-281a8c192ecc None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:57.831948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:57.832853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:57.833149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:57.833497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:57.834536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:57.835024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:57.836920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:57.846757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 623/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:05:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:57.852795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:57.958469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e8d37-61ce-496a-9462-9f8f7584d968 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:57.996176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:57.997028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:57.997652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:57.997953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:58.009561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:58.011490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:05:58.031665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:58.033298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:58.034496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:05:58.034496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:05:58.034496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:58.034496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:58.034496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 601/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:58.040336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:58.155874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ef976-ff20-4a22-9b96-5f720da3cc39 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:58.192883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:58.193600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:58.193879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:58.194187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:58.195084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:58.195440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:58.197035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:58.211336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 624/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:58.217513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:58.322161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15551db-6a31-4614-ae37-eecb5a9e22f3 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:58.359806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:58.360609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:58.360885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:58.361150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:58.368852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:58.370469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:05:58.388566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:58.389869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:58.391141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 602/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:05:58.395832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:58.510001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da600-6764-400c-8713-cc842129a788 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:58.550831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:58.551583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:58.551903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:58.552299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:58.553202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:58.553620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:58.555510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:58.581712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 625/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 4 08:05:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:58.582868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:58.686286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3db79-85f5-4687-baf0-777791379a49 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:58.723134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:58.724009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:58.724321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:58.724648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:58.736085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:58.737690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:05:58.761485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:58.762781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:58.763973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:05:58.763973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:05:58.763973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:05:58.763973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:58.763973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 603/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:58.769522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:58.883417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe2cd9-b639-4efb-9861-6eb8d098ae5e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:58.919910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:58.920671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:58.921029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:58.921308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:58.922030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:58.922334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:58.923779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:58.935421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 626/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:05:58.941383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:59.052205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ba7e8-825c-47f0-b559-bcf1b2e644d8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:59.089761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:59.091257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:59.091576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:59.091910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:59.099387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:59.101999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:05:59.119581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:05:59.120752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:05:59.121800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 604/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:05:59.127833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:59.244146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fcf1-6aeb-4581-ab45-2b30eae94d23 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:59.282440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:59.283182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:59.283446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:59.283808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:59.284711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:05:59.285046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:59.286592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0af79b-2789-470b-a494-fdb8841c7e61 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:59.300643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 627/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:05:59.309374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:05:59.416627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df288a5-6810-4540-8518-bc67ea016469 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:05:59.454585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8f2a6-5444-4b57-a43d-b1bed211ab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:05:59.455508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8f2a6-5444-4b57-a43d-b1bed211ab6e None admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:05:59.455790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8f2a6-5444-4b57-a43d-b1bed211ab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:05:59.456056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8f2a6-5444-4b57-a43d-b1bed211ab6e None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/89b99e7835d04098ad38e4eee401ea91/roles/30cd7fa57f07459cb9e06c4e34b4475f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:05:59.472674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8f2a6-5444-4b57-a43d-b1bed211ab6e None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=89b99e7835d04098ad38e4eee401ea91, role_id=30cd7fa57f07459cb9e06c4e34b4475f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:05:59.474156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8f2a6-5444-4b57-a43d-b1bed211ab6e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:05:59.487645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 605/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:05:59 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/89b99e7835d04098ad38e4eee401ea91/roles/30cd7fa57f07459cb9e06c4e34b4475f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:06:01.824748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff1c5-672f-4578-8b51-7d09feb7a626 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:01.825282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff1c5-672f-4578-8b51-7d09feb7a626 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:01.825381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff1c5-672f-4578-8b51-7d09feb7a626 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:01.827732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 628/1233] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:01.833616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:01.834031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:01.834229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:01.855578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:01.856794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:01.928616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 606/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:01.955107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff1c5-672f-4578-8b51-7d09feb7a626 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:02.066396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff1c5-672f-4578-8b51-7d09feb7a626 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:02.100929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:02.101633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:02.101950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:02.102187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:02.112138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:06:02.121128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:02.122296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:02.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 629/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Wed May 4 08:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:02.131285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:02.233432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec4f7f-c7f4-493f-b01f-19007ff07194 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:02.273558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:02.274232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:02.274524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:02.274850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:02.275758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] RBAC: Adding query filter params (name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:02.276162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:02.277864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:02.286729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 607/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Wed May 4 08:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:02.293162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:02.405009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e8ba-e420-4851-8fe3-8ffb6a754c0d None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:02.446294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:02.447221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:02.447562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:02.447871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:02.459660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:02.461212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:02.479225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:02.480255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:02.481444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:02.481444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:02.481444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:02.481444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:02.481444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 630/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:06:02.487032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:02.601383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef37d70-e1ff-411a-8279-c010557fa006 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:02.636764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:02.637496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:02.637768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:02.638075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:02.638906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:02.639206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:02.640566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:02.653471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 608/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:02.659264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:02.765114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805e51d-b9eb-4636-a31a-2afefa160c16 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:02.799757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:02.800617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:02.800898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:02.801171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:02.810257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:02.812061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:06:02.831434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:02.833238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:02.834505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:02.835326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 631/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:02.839864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:02.947916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c7ff9-67e6-4904-80f7-e09bff0e24e7 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:02.987484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:02.988149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:02.988421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:02.988686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:02.989509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:02.989808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:02.991286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:03.010254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 609/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 4 08:06:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:06:03.016206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:03.124887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71aabc-bd17-476a-a5a7-dd8b1dbf3ebe None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:03.162804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:03.163663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:03.164011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:03.164366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:03.237420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:03.239188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:03.341488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 632/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:06:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:06:03.348177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:03.458516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22070-83e6-4476-9171-31398f00ca78 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:03.493868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:03.494679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:03.494997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:03.495268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:03.505974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:03.507504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:03.527794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:03.529080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:03.531937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:03.531937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:03.531937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:03.531937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:03.531937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 610/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:03.535102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:03.639094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c41e-b388-4c84-99f8-ff32ed7a636e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:03.671995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:03.672751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:03.673024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:03.673286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:03.674077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:03.674380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:03.675779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:03.687542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 633/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:03.694033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:03.805746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0ace7-013b-42aa-a5a1-5e568c055532 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:03.847972 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:03.848833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:03.849028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:03.849288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:03.856307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:03.857729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:06:03.871689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:03.872832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:03.873910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 611/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:06:03.880984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:03.990282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f3aa2-ab2d-4647-9a55-3d4537063163 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:04.028054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:04.028903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:04.029355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:04.029812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:04.030679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:04.031106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:04.032604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4634d9-6af3-46e0-819b-0363df1a1cf9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:04.045533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 634/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:04.051641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:04.165656 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f09f53-c43b-4a99-bb9d-d0183f3fdcd8 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:04.200837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:04.201498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:04.202273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:04.202273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:04.202867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] RBAC: Adding query filter params (role.id=30cd7fa57f07459cb9e06c4e34b4475f, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=89b99e7835d04098ad38e4eee401ea91) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:04.203209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:04.204641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec27b-69ff-430e-b7f9-74bf3a98b279 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:04.210682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 612/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:06:04 2022] GET /identity/v3/role_assignments?user.id=89b99e7835d04098ad38e4eee401ea91&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=30cd7fa57f07459cb9e06c4e34b4475f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:06:06.916844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb603-97ac-47ab-a987-1a8e8d6e7fc0 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:06.917487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb603-97ac-47ab-a987-1a8e8d6e7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:06.917487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb603-97ac-47ab-a987-1a8e8d6e7fc0 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:06.918934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 635/1247] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:06.925802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:06.926273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:06.926273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:06.943413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:06.944592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:07.018396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 613/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 08:06:07.041815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb603-97ac-47ab-a987-1a8e8d6e7fc0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:07.154931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb603-97ac-47ab-a987-1a8e8d6e7fc0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:07.192687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:07.193554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:07.193954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:07.194262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:07.205174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:06:07.213568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:07.214680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:07.215812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 636/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:07.221334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:07.322318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2794a-3f99-4dcf-b00e-be12bc249648 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:07.374111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:07.374776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:07.375077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:07.375432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:07.376270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:07.376575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:07.378086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:07.387335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 614/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:07.393078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:07.498070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a0f9a-4703-4621-8b27-7433c7cc5030 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:07.533117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:07.533933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:07.534205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:07.534526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:07.545218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:07.546813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:07.565245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:07.566458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:07.567612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:07.567612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:07.567612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:07.567612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:07.567612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 637/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:06:07.572589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:07.678770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0e8f1-ac1a-4e92-a279-d045a5407742 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:07.714662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:07.715546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:07.715881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:07.716232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:07.717131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:07.717440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:07.719102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:07.731985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 615/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:07.737831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:07.851319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035f507-e85b-4f5d-9bf4-2a802bdc3111 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:07.890710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:07.891668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:07.892007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:07.892351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:07.901653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:07.903285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:06:07.918589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:07.920368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:07.921662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 638/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:06:07.926065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:08.036918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda4ddc-03f9-4fd7-9aa5-eb68853f4827 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:08.071192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:08.071883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:08.072161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:08.072425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:08.073269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:08.073566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:08.075078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:08.094446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 616/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 4 08:06:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:08.100351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:08.205951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c3887-a279-4e84-9562-b41bd7eb67e4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:08.242923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:08.243668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:08.243939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:08.244200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:08.318555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:08.320084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:08.417169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 639/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:06:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:06:08.423239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:08.523238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d6825-b102-4682-9b5b-c36aff691100 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:08.556049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:08.556808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:08.557078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:08.557355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:08.567634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:08.569062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:08.586100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:08.587257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:08.588614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:08.588614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:08.588614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:08.588614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:08.588614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 617/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:08.593164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:08.708292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a97c20-df11-44e3-bb85-08f932e679a9 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:08.741570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:08.742304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:08.742582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:08.742856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:08.743611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:08.743916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:08.745289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:08.756152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 640/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:08.762140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:08.874526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f68e1b-9823-4d34-a2e0-df11c08503c0 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:08.908934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:08.909716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:08.909994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:08.910263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:08.917320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:08.918750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:06:08.932501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:08.933945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:08.935134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:08.938423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 618/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:08.939542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:09.034895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500a868-2024-4e43-aec1-a2326f839fe5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:09.068812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:09.069470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:09.069802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:09.070081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:09.070835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:09.071175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:09.072611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a6d4b-a584-4fd4-9d8f-57df2b3f98ce None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:09.084139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 641/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:06:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:09.094016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:09.200382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1d513-c5b4-4ff5-925a-cb8169a66ad6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:09.233360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:09.233985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:09.234220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:09.234512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:09.235353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=89b99e7835d04098ad38e4eee401ea91) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:09.235654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:09.237069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df0bd1-a8c7-415b-b164-53532bbf3d91 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:09.242430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 619/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:06:09 2022] GET /identity/v3/role_assignments?user.id=89b99e7835d04098ad38e4eee401ea91&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:11.456465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1d08-1166-4ef8-bb44-ec40384f790e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:11.457013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1d08-1166-4ef8-bb44-ec40384f790e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:11.457013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1d08-1166-4ef8-bb44-ec40384f790e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:11.458384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 642/1261] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:11.465038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:11.465746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:11.466017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:11.489154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:11.490330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:11.565667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 620/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:11.596567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1d08-1166-4ef8-bb44-ec40384f790e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:11.717099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1d08-1166-4ef8-bb44-ec40384f790e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:11.751643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:11.752421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:11.752700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:11.752971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:11.764871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:06:11.772624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:11.773714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:11.774605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 643/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:11.781951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:11.901415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd15bce-daa6-45f8-8ae8-a83d538bcd54 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:11.932811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:11.933494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:11.933765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:11.934032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:11.934761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:11.935085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:11.936451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:11.945419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 621/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:06:11.954180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:12.055081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbafd3-977a-461e-8dbb-6b527ed31999 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:12.089690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:12.090454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:12.090728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:12.091018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:12.101291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:12.102719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:12.119302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:12.120279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:12.121360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:12.121360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:12.121360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:12.121360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:12.121360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 644/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:06:12.129104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:12.236760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac9e8f-4842-4440-9d09-8aff43d2f59d None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:12.269952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:12.270590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:12.270861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:12.271149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:12.271851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:12.272149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:12.273588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:12.285063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 622/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:12.290994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:12.401541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ebfd-2792-49f4-9fcc-845c60149a3e None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:12.435074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:12.435862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:12.436126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:12.436391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:12.444233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:12.445681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:06:12.459848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:12.461526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:12.462706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 645/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:12.467888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:12.568131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c68eae-bb45-4bbf-8211-b265dd9fdcda None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:12.602356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:12.603033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:12.603310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:12.603569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:12.604387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:12.604684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:12.606097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:12.624785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 623/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 4 08:06:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:12.630672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:12.744925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac515e8-112b-44cd-aecd-f91a6e2bb0c5 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:12.778382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:12.779194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:12.779498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:12.779760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:12.790767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:12.792308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:12.817027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:12.818058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:12.819117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:12.819117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:12.819117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:12.819117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:12.819117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 646/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 08:06:12.826582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:12.927092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a3423-f318-40af-b91a-bc649c05f8c6 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:12.960774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:12.961416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:12.961695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:12.961964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:12.962679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:12.963002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:12.964377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:12.975223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 624/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:12.984311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:13.099004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b177-5df4-4445-bf48-4835d130f955 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:13.134138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:13.134921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:13.135203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:13.135465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:13.142260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:13.143717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:06:13.157997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:13.159064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:13.160418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 647/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:13.168341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:13.273582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b50ce-0627-4e5d-ae40-1376746aa94c None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:13.315633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:13.316276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:13.316550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:13.316818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:13.317590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:13.317893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:13.319335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bfb4d-1e3b-4092-a021-dd4cf69680ed None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:13.331850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 625/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:13.339178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:13.455088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5abe2-d5ae-4bd1-9b43-719c9cb8683c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:13.500354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2a56d-9f1e-444f-89a1-a00e0a46c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:13.501224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2a56d-9f1e-444f-89a1-a00e0a46c92b None admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:13.501500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2a56d-9f1e-444f-89a1-a00e0a46c92b None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:13.501769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2a56d-9f1e-444f-89a1-a00e0a46c92b None admin] PATH_INFO: `/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/89b99e7835d04098ad38e4eee401ea91/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:13.503997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2a56d-9f1e-444f-89a1-a00e0a46c92b None admin] RBAC: Authorizing `identity:create_grant(project_id=cdccacd6b02847d1bb2b3cff695ee20d, user_id=89b99e7835d04098ad38e4eee401ea91, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:13.505432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2a56d-9f1e-444f-89a1-a00e0a46c92b None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:13.519602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 648/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Wed May 4 08:06:13 2022] PUT /identity/v3/projects/cdccacd6b02847d1bb2b3cff695ee20d/users/89b99e7835d04098ad38e4eee401ea91/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:06:15.751175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730c13-c6a6-4f34-ae66-a3d99f32dd2e None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:15.751711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730c13-c6a6-4f34-ae66-a3d99f32dd2e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:15.751711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730c13-c6a6-4f34-ae66-a3d99f32dd2e None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:15.753686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 626/1274] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:15.760019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:15.760711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:15.760853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:15.787205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:15.789080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:15.867580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 649/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:15.892225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730c13-c6a6-4f34-ae66-a3d99f32dd2e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:15.995283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730c13-c6a6-4f34-ae66-a3d99f32dd2e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:16.029219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:16.029915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:16.030188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:16.030453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:16.040829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 08:06:16.048382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:16.049553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:16.051304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 627/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Wed May 4 08:06:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:16.057260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:16.155024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ff9f-07bf-446f-93b8-5044b6755bc8 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:16.190724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:16.191399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:16.191673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:16.191953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:16.192690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:16.193000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:16.194643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:16.203091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 650/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Wed May 4 08:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:16.211494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:16.333580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569ac89-8ad0-4d20-bed8-c62d531c5512 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:16.367288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:16.368065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:16.368341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:16.368609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:16.379284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:16.380714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:16.398379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:16.399443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:16.400746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:16.400746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:16.400746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:16.400746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:16.400746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 628/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:16.405419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:16.517111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feb0b5-8e3e-469f-a551-e192bf6d8886 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:16.551025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:16.551672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:16.551946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:16.552209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:16.552924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:16.553251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:16.554611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:16.565932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 651/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:16.572264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:16.676553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655434e4-cc9c-427d-96f1-98ca21d02ede None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:16.708873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:16.709660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:16.709941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:16.710229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:16.720252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:16.722419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 08:06:16.738595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:16.739731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:16.741100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 629/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:16.746430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:16.851032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4b4f4-75c0-4e9b-83d6-4ef09121aca6 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:16.884206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:16.884857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:16.885129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:16.885405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:16.886221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:16.886499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:16.887977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:16.906535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 652/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Wed May 4 08:06:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:16.912517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:17.011584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c8bf6-ec5e-41f3-9b7b-7398509e1154 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:17.045244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:17.045869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:17.046115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:17.046408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:17.111855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:17.113279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:17.208951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 630/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Wed May 4 08:06:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 08:06:17.215063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:17.326580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975703ec-d6d0-48d0-bb50-fd9d97f35ff4 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:17.360599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:17.361378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:17.361650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:17.361921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:17.372060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:17.373501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 08:06:17.391606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:17.392687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:17.393660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 08:06:17.393660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 08:06:17.393660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 08:06:17.393660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:17.393660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 653/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:17.398719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:17.492207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3293a04-33e7-4a37-9a05-e059a2224259 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:17.526124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:17.526766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:17.527069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:17.527338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:17.528052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:17.528350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:17.529720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:17.540773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 631/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Wed May 4 08:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:17.546712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:17.646770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930d95-2a1c-48f5-8b8b-cf9ee476d61c None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:17.680484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:17.681250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:17.681524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:17.681789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:17.688636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:17.690387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 08:06:17.704064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application with Lock( May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:17.705137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: ERROR keystone.server.flask.application May 04 08:06:17.706447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 654/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Wed May 4 08:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:17.711055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:17.827932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984652a6-282d-41ce-a8c2-fb2cb09f4ed5 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:17.863793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:17.864441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:17.864722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:17.864995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:17.865772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:17.866080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:17.867649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90f35c-90ba-486b-aa39-ff1381b624c5 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:17.879514 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 632/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Wed May 4 08:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:17.886696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:17.985400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b230c5-c683-4f31-8569-86900b6ac2ed None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:18.019443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:18.020071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:18.020351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:18.020620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:18.021439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] RBAC: Adding query filter params (role.id=bb155e3b668f49279f0b119fcecee2c2, scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d, user.id=89b99e7835d04098ad38e4eee401ea91) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:18.021740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:18.023212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba10481-1f8f-4330-8ba2-9db721458d51 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:18.029048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 655/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Wed May 4 08:06:17 2022] GET /identity/v3/role_assignments?user.id=89b99e7835d04098ad38e4eee401ea91&scope.project.id=cdccacd6b02847d1bb2b3cff695ee20d&role.id=bb155e3b668f49279f0b119fcecee2c2 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:20.245553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b2cf-c4d1-4b3f-9470-3fe01a7e4570 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:20.246441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b2cf-c4d1-4b3f-9470-3fe01a7e4570 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:20.246441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b2cf-c4d1-4b3f-9470-3fe01a7e4570 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:20.248660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 633/1288] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:20.254820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:20.255579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:20.255732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:20.275839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:20.277014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:20.347461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 656/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:20.384186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b2cf-c4d1-4b3f-9470-3fe01a7e4570 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:20.493675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b2cf-c4d1-4b3f-9470-3fe01a7e4570 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:20.528717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:20.529438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:20.529715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:20.529983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:20.530628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:20.532021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:20.543808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:20.545184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:20.546480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 634/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:06:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:20.551613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:20.653465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb0228-c192-4fad-a377-3f32cc0d810d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:20.688588 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:20.689585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:20.690294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:20.690710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:20.691854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] RBAC: Adding query filter params (name=placement) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:20.692316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:20.694477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca303-a583-4b5b-a559-027de965dcee None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:20.702659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 657/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 4 08:06:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:20.711183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:20.833582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079ca1d-0a89-46be-a8a8-5f55aef19a6a None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:20.872047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:20.872708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:20.872987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:20.873294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] PATH_INFO: `/v3/services` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:20.874023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:20.874327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:20.875720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473c50e-91a3-4c4b-8947-4b33b142d35e None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:20.882917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 635/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 4 08:06:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:23.101142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523a642-f46e-4e79-bd3c-66a5345ddde0 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:23.101725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523a642-f46e-4e79-bd3c-66a5345ddde0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:23.101725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523a642-f46e-4e79-bd3c-66a5345ddde0 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:23.103081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 658/1293] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:23.109515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5a79-1605-4f1f-8ce7-e1cf322e5d16 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:23.110258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5a79-1605-4f1f-8ce7-e1cf322e5d16 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:23.110383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5a79-1605-4f1f-8ce7-e1cf322e5d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:23.131365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-863e5a79-1605-4f1f-8ce7-e1cf322e5d16 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:23.132533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-863e5a79-1605-4f1f-8ce7-e1cf322e5d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:23.205815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 636/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:23.228862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523a642-f46e-4e79-bd3c-66a5345ddde0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:23.332562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523a642-f46e-4e79-bd3c-66a5345ddde0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:23.366395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2ec9-6d2f-429e-81b7-943aa3ddc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:23.367063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2ec9-6d2f-429e-81b7-943aa3ddc743 None admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:23.367339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2ec9-6d2f-429e-81b7-943aa3ddc743 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:23.367606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2ec9-6d2f-429e-81b7-943aa3ddc743 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:23.368324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2ec9-6d2f-429e-81b7-943aa3ddc743 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:23.369681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2ec9-6d2f-429e-81b7-943aa3ddc743 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:23.385795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 659/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Wed May 4 08:06:23 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:06:25.635745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0822-79f8-4ec3-9dca-4cb52afaed64 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:25.636630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0822-79f8-4ec3-9dca-4cb52afaed64 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:25.636630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0822-79f8-4ec3-9dca-4cb52afaed64 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:25.638698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 637/1296] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:25.645021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:25.645446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:25.645586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:25.669286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:25.670400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:25.754062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 660/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:25.777039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0822-79f8-4ec3-9dca-4cb52afaed64 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:25.897148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0822-79f8-4ec3-9dca-4cb52afaed64 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:25.931153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:25.931873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:25.932149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:25.932415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:25.933060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:25.934452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:25.946651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:25.947809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:25.948920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 638/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:06:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:25.953879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:26.055363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5d3a2-5a1a-4416-bac8-59f65ce52b57 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:26.089473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:26.090113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:26.090389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:26.090662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:26.091397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:26.091693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:26.093057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:26.098390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 661/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 4 08:06:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:26.104871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:26.205862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573d384-a945-4586-9bd2-fa983efd58dd None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:26.239137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:26.239771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:26.240057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:26.240313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:26.241109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] RBAC: Adding query filter params (interface=public, service_id=f522171377ee4179b3cae54e30090a59, region_id=RegionOne) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:26.241392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:26.242733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cb67b-9745-4fe6-9359-0ce46bbb0791 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:26.247770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 639/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Wed May 4 08:06:26 2022] GET /identity/v3/endpoints?service_id=f522171377ee4179b3cae54e30090a59&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:26.253702 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:26.358408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee553379-ec15-4c08-8846-4849a14f8d88 None admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:26.391886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6674e6-004b-4655-9681-25568e29892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:26.392545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6674e6-004b-4655-9681-25568e29892c None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:26.392820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6674e6-004b-4655-9681-25568e29892c None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:26.393087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6674e6-004b-4655-9681-25568e29892c None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:26.393764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6674e6-004b-4655-9681-25568e29892c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:26.395148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6674e6-004b-4655-9681-25568e29892c None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:26.402085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 662/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Wed May 4 08:06:26 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:06:28.623452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e000d0-8215-4622-971b-aa7273d35361 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:28.623999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e000d0-8215-4622-971b-aa7273d35361 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:28.623999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e000d0-8215-4622-971b-aa7273d35361 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:28.625353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 640/1302] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:06:28.631893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:28.632603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:28.632752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:28.660969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:06:28.662766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:06:28.732583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 663/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:06:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 08:06:28.765991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e000d0-8215-4622-971b-aa7273d35361 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:28.876329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e000d0-8215-4622-971b-aa7273d35361 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:28.910446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:28.911323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:28.911543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:28.911813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:28.912461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:28.913848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 08:06:28.925791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 08:06:28.926960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.get_or_create( May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application with Lock( May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self._enter() May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application return self.creator() May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application created_value = creator( May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: ERROR keystone.server.flask.application May 04 08:06:28.927849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 641/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Wed May 4 08:06:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 08:06:28.933806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:29.051457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ff6c-5725-49b3-a54e-ab11a9007349 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:29.085495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:29.086143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:29.086424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:29.086700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] PATH_INFO: `/v3/services` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:29.087438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:06:29.087751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:29.089118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b363a-cee5-45ba-a81e-1f831903f92a None admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:29.094349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 664/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Wed May 4 08:06:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:06:29.100680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:06:29.200792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4b466-550c-4b24-9c43-1acee9003085 None admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:06:29.234409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066ce1c-eccd-4c27-a834-1cd2f15f6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:06:29.235081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066ce1c-eccd-4c27-a834-1cd2f15f6980 None admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:06:29.235357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066ce1c-eccd-4c27-a834-1cd2f15f6980 None admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:06:29.235628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066ce1c-eccd-4c27-a834-1cd2f15f6980 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:06:29.236358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066ce1c-eccd-4c27-a834-1cd2f15f6980 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:06:29.237708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066ce1c-eccd-4c27-a834-1cd2f15f6980 None admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:06:29.260536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 642/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Wed May 4 08:06:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:07:32.603592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221f81-9e68-45ec-8e0e-4367848e86e9 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:32.604487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221f81-9e68-45ec-8e0e-4367848e86e9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:32.604908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221f81-9e68-45ec-8e0e-4367848e86e9 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:32.610146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 665/1307] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:32.611630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603582a-533b-44c8-8197-99bf3d99c726 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:32.612426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603582a-533b-44c8-8197-99bf3d99c726 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:32.612853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603582a-533b-44c8-8197-99bf3d99c726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:32.696557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7603582a-533b-44c8-8197-99bf3d99c726 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:32.699812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7603582a-533b-44c8-8197-99bf3d99c726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:32.867758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 643/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:07:32.916930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05835ba0-ab1d-45b1-bc16-61dfbdbfadb7 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:32.917365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05835ba0-ab1d-45b1-bc16-61dfbdbfadb7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:32.917644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05835ba0-ab1d-45b1-bc16-61dfbdbfadb7 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:32.919744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 666/1309] 10.222.0.59 () {54 vars in 964 bytes} [Wed May 4 08:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:32.925747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1fdf-3c83-4997-b561-44381402578b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:32.926043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1fdf-3c83-4997-b561-44381402578b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:32.926319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1fdf-3c83-4997-b561-44381402578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:33.019411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9b3a1fdf-3c83-4997-b561-44381402578b None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:33.020736 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9b3a1fdf-3c83-4997-b561-44381402578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:33.096651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 644/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Wed May 4 08:07:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:33.105571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05835ba0-ab1d-45b1-bc16-61dfbdbfadb7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:33.107337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-05835ba0-ab1d-45b1-bc16-61dfbdbfadb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:33.211725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05835ba0-ab1d-45b1-bc16-61dfbdbfadb7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:33.286354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:33.286991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:33.287272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:33.287541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:33.289346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:33.398901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:33.403553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430e29-f583-4cac-9ebd-4cfed82fe398 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:33.421322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 667/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:35.919776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c181-70e0-4a08-9578-80888acbe91d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:35.920315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c181-70e0-4a08-9578-80888acbe91d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:35.920315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338c181-70e0-4a08-9578-80888acbe91d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:35.921628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 645/1312] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:35.927049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a95c7-e773-45f6-95ab-7391c0823395 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:35.927506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a95c7-e773-45f6-95ab-7391c0823395 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:35.927800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a95c7-e773-45f6-95ab-7391c0823395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:36.000019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3c3a95c7-e773-45f6-95ab-7391c0823395 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:36.001396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3c3a95c7-e773-45f6-95ab-7391c0823395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:36.097244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 668/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:36.135307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c181-70e0-4a08-9578-80888acbe91d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:36.137165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f338c181-70e0-4a08-9578-80888acbe91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:36.243745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338c181-70e0-4a08-9578-80888acbe91d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:36.318120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:36.318963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:36.319347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:36.319715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:36.321450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:36.431871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:36.433469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ed3fc-37da-4f25-bca4-d7795ca9e0e2 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:36.452915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 646/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:39.036326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf95b1-7bb5-4fed-9026-530a9c74a9ad None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:39.036896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf95b1-7bb5-4fed-9026-530a9c74a9ad None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:39.036896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf95b1-7bb5-4fed-9026-530a9c74a9ad None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:39.038152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 669/1315] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:39.043637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c326-8d24-4f65-88fa-648260a80cf8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:39.044122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c326-8d24-4f65-88fa-648260a80cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:39.044231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c326-8d24-4f65-88fa-648260a80cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:39.113005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d0f2c326-8d24-4f65-88fa-648260a80cf8 None None] MFA Rules not processed for user `86e9df2ea0c64543b814c1aa6b7b6b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:39.114794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d0f2c326-8d24-4f65-88fa-648260a80cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:39.218844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 647/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:39.276117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d223c-9d3e-4817-b268-80c059ba2cab None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:39.276366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d223c-9d3e-4817-b268-80c059ba2cab None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:39.276744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d223c-9d3e-4817-b268-80c059ba2cab None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:39.278803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 670/1317] 10.222.0.59 () {54 vars in 964 bytes} [Wed May 4 08:07:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:39.288405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1d3d-f88c-415b-b9e8-80422925b8c8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:39.288909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1d3d-f88c-415b-b9e8-80422925b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:39.289379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c1d3d-f88c-415b-b9e8-80422925b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:39.371025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1a0c1d3d-f88c-415b-b9e8-80422925b8c8 None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:39.372235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1a0c1d3d-f88c-415b-b9e8-80422925b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:39.447933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 648/1318] 10.222.0.59 () {58 vars in 1061 bytes} [Wed May 4 08:07:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:39.457309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d223c-9d3e-4817-b268-80c059ba2cab None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:39.459883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3a1d223c-9d3e-4817-b268-80c059ba2cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:39.566030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d223c-9d3e-4817-b268-80c059ba2cab None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:39.638015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:39.638649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:39.638920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:39.639216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:39.640819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:39.765547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:39.767061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec446b7-03ed-4b98-a0c1-310afc2acd9b service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:39.788778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 671/1319] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:42.974693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e457107-2cc9-4984-b655-c51b4b5fada3 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:42.975568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e457107-2cc9-4984-b655-c51b4b5fada3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:42.975568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e457107-2cc9-4984-b655-c51b4b5fada3 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:42.977723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 649/1320] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:42.984253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7e08e-8dc5-4c94-ab12-e31f4159d86c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:42.984907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7e08e-8dc5-4c94-ab12-e31f4159d86c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:42.985056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7e08e-8dc5-4c94-ab12-e31f4159d86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:43.055990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e3e7e08e-8dc5-4c94-ab12-e31f4159d86c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:43.057175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e3e7e08e-8dc5-4c94-ab12-e31f4159d86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:43.161355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 672/1321] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:43.200740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e457107-2cc9-4984-b655-c51b4b5fada3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:43.203156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2e457107-2cc9-4984-b655-c51b4b5fada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:43.336044 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e457107-2cc9-4984-b655-c51b4b5fada3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:43.420314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:43.420964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:43.421244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:43.421516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:43.423185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:43.538416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:43.539862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb536389-4649-4e9e-97c4-f4039c603cc9 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:43.558084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 650/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:46.557861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c504ef-8524-4383-954f-389137d1fc3b None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:46.558443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c504ef-8524-4383-954f-389137d1fc3b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:46.558443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c504ef-8524-4383-954f-389137d1fc3b None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:46.559872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 673/1323] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:46.565411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6461-318b-4285-8ed6-3a7939033b4e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:46.565842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6461-318b-4285-8ed6-3a7939033b4e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:46.565936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6461-318b-4285-8ed6-3a7939033b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:46.630176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-4a0b6461-318b-4285-8ed6-3a7939033b4e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:46.631391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4a0b6461-318b-4285-8ed6-3a7939033b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:46.728186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 651/1324] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:46.764999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c504ef-8524-4383-954f-389137d1fc3b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:46.766591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c1c504ef-8524-4383-954f-389137d1fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:46.873369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c504ef-8524-4383-954f-389137d1fc3b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:46.947258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:46.947849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:46.948124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:46.948392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:46.950024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:47.061353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:47.062801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5f48f-55ce-4399-8e72-ab099d51350e service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:47.083381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 674/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:49.348576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c274f-f809-460a-b26a-d7cdfceb51ad None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:49.349155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c274f-f809-460a-b26a-d7cdfceb51ad None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:49.349155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c274f-f809-460a-b26a-d7cdfceb51ad None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:49.351236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 652/1326] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:49.356555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632fb7c-963c-4902-8949-1b9c1126dae4 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:49.356973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632fb7c-963c-4902-8949-1b9c1126dae4 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:49.357136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632fb7c-963c-4902-8949-1b9c1126dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:49.421366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d632fb7c-963c-4902-8949-1b9c1126dae4 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:49.422582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d632fb7c-963c-4902-8949-1b9c1126dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:49.517988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 675/1327] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:49.554387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c274f-f809-460a-b26a-d7cdfceb51ad None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:49.555940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-880c274f-f809-460a-b26a-d7cdfceb51ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:49.661825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c274f-f809-460a-b26a-d7cdfceb51ad None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:49.733845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:49.734489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:49.734764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:49.735064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:49.736685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:49.846540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:49.848031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e7bab-b068-47dd-a131-310fde7855e2 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:49.866248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 653/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:07:52.134912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee874d5-09e7-4faa-a72d-ae45cba05c87 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:52.135500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee874d5-09e7-4faa-a72d-ae45cba05c87 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:52.135500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee874d5-09e7-4faa-a72d-ae45cba05c87 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:52.136808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 676/1329] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:52.142341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a438b-899c-41f0-a932-989a10d5673f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:52.142762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a438b-899c-41f0-a932-989a10d5673f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:52.142940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a438b-899c-41f0-a932-989a10d5673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:52.208241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-839a438b-899c-41f0-a932-989a10d5673f None None] MFA Rules not processed for user `86e9df2ea0c64543b814c1aa6b7b6b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:52.209710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-839a438b-899c-41f0-a932-989a10d5673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:52.304883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 654/1330] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:52.342204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee874d5-09e7-4faa-a72d-ae45cba05c87 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:52.343691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0ee874d5-09e7-4faa-a72d-ae45cba05c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:52.447518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee874d5-09e7-4faa-a72d-ae45cba05c87 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:52.520253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:52.520895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:52.521168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:52.521428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:52.523069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:52.632209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:52.633663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca51105-4a9b-4c51-a33f-b8025fda2fb6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:52.651388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 677/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:55.105762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55192c-19c1-4ccb-9d9b-f4246450e8aa None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:55.106451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55192c-19c1-4ccb-9d9b-f4246450e8aa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:55.106546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55192c-19c1-4ccb-9d9b-f4246450e8aa None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:55.107957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 655/1332] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:55.114975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc8442-cefa-47ec-bdd9-d42c0706cf3b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:55.115407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc8442-cefa-47ec-bdd9-d42c0706cf3b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:55.115532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc8442-cefa-47ec-bdd9-d42c0706cf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:55.191369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f8bc8442-cefa-47ec-bdd9-d42c0706cf3b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:55.192519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f8bc8442-cefa-47ec-bdd9-d42c0706cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:55.291740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 678/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:55.328205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55192c-19c1-4ccb-9d9b-f4246450e8aa None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:55.329860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7a55192c-19c1-4ccb-9d9b-f4246450e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:55.439910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55192c-19c1-4ccb-9d9b-f4246450e8aa None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:55.517951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:55.518756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:55.519088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:55.519356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:55.521049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:55.631784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:55.633264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093e6c5-66eb-4de1-a05c-12ff788fdb25 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:55.656506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 656/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:07:57.914642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a7365-1893-4017-8491-0873e6f23d2c None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:57.915549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a7365-1893-4017-8491-0873e6f23d2c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:57.915549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a7365-1893-4017-8491-0873e6f23d2c None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:57.917645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 679/1335] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:07:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:07:57.923041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b07b1-1ac1-4dbb-b066-2061f7c384ba None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:57.923491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b07b1-1ac1-4dbb-b066-2061f7c384ba None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:57.923587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b07b1-1ac1-4dbb-b066-2061f7c384ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:57.996932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fa2b07b1-1ac1-4dbb-b066-2061f7c384ba None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:07:57.998161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fa2b07b1-1ac1-4dbb-b066-2061f7c384ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:58.097010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 657/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:07:58.142664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a7365-1893-4017-8491-0873e6f23d2c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:07:58.144333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3c2a7365-1893-4017-8491-0873e6f23d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:58.258553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a7365-1893-4017-8491-0873e6f23d2c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:07:58.349940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:07:58.350594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:07:58.350875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:07:58.351169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:07:58.352849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:07:58.460418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:07:58.461895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809e32f-cc3a-4c2b-9b0f-9f8c1ab05bc6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:07:58.480151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 680/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:01.129285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848391-f749-4a5b-b5eb-3552fa7041f0 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:01.129885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848391-f749-4a5b-b5eb-3552fa7041f0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:01.129885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848391-f749-4a5b-b5eb-3552fa7041f0 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:01.131501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 658/1338] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:01.137616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aa168-a1eb-4d5b-a915-36ce5c90f3b7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:01.138390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aa168-a1eb-4d5b-a915-36ce5c90f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:01.138517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aa168-a1eb-4d5b-a915-36ce5c90f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:01.214487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f05aa168-a1eb-4d5b-a915-36ce5c90f3b7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:01.215731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f05aa168-a1eb-4d5b-a915-36ce5c90f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:01.316623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 681/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:01.353614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848391-f749-4a5b-b5eb-3552fa7041f0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:01.356066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-01848391-f749-4a5b-b5eb-3552fa7041f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:01.466114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848391-f749-4a5b-b5eb-3552fa7041f0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:01.560938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:01.561838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:01.562142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:01.562458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:01.565425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:01.687939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:01.690216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac8ef7-91ad-4f74-accb-4a8958b2eae9 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:01.709845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 659/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:05.989175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100a6d-c91b-4a96-9b94-ea70ab2f2902 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:05.989700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100a6d-c91b-4a96-9b94-ea70ab2f2902 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:05.989700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100a6d-c91b-4a96-9b94-ea70ab2f2902 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:05.991079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 682/1341] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:05.996439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bc78-1bab-401b-a84c-ddddbfccb406 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:05.996839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bc78-1bab-401b-a84c-ddddbfccb406 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:05.997018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bc78-1bab-401b-a84c-ddddbfccb406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:06.069847 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3be1bc78-1bab-401b-a84c-ddddbfccb406 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:06.070939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3be1bc78-1bab-401b-a84c-ddddbfccb406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:06.174994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 660/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:06.213643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100a6d-c91b-4a96-9b94-ea70ab2f2902 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:06.216152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cf100a6d-c91b-4a96-9b94-ea70ab2f2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:06.316090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100a6d-c91b-4a96-9b94-ea70ab2f2902 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:06.320031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2b34-6b65-4c78-beaa-036357f795b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:06.320684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2b34-6b65-4c78-beaa-036357f795b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:06.320952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2b34-6b65-4c78-beaa-036357f795b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:06.321224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2b34-6b65-4c78-beaa-036357f795b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:06.330425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d2b34-6b65-4c78-beaa-036357f795b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:06.332027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d2b34-6b65-4c78-beaa-036357f795b6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:06.342554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 683/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:09.114990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64cdc-f1cb-4c05-9eed-68b3c1ec5a6a None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:09.115599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64cdc-f1cb-4c05-9eed-68b3c1ec5a6a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:09.115599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64cdc-f1cb-4c05-9eed-68b3c1ec5a6a None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:09.116913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 661/1344] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:09.122252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefd02-4a9e-4037-a969-7b20134d6590 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:09.122745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefd02-4a9e-4037-a969-7b20134d6590 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:09.122974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefd02-4a9e-4037-a969-7b20134d6590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:09.151782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e7eefd02-4a9e-4037-a969-7b20134d6590 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:09.152978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e7eefd02-4a9e-4037-a969-7b20134d6590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:09.234064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 684/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:09.270943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64cdc-f1cb-4c05-9eed-68b3c1ec5a6a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:09.282461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64cdc-f1cb-4c05-9eed-68b3c1ec5a6a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:09.286575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecbd57-3d56-46a6-87b3-f4fb5802ca76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:09.287249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbd57-3d56-46a6-87b3-f4fb5802ca76 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:09.287528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbd57-3d56-46a6-87b3-f4fb5802ca76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:09.287795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecbd57-3d56-46a6-87b3-f4fb5802ca76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:09.297257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbd57-3d56-46a6-87b3-f4fb5802ca76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:09.298689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecbd57-3d56-46a6-87b3-f4fb5802ca76 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:09.308344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 662/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:13.602866 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269530a8-6ade-4ade-a25f-a60c4097d03e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:13.603292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269530a8-6ade-4ade-a25f-a60c4097d03e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:13.603506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269530a8-6ade-4ade-a25f-a60c4097d03e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:13.604898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 685/1347] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:13.610366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046886-19a6-475a-adfd-81e00b9609f8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:13.610832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046886-19a6-475a-adfd-81e00b9609f8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:13.610953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046886-19a6-475a-adfd-81e00b9609f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:13.628978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-23046886-19a6-475a-adfd-81e00b9609f8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:13.630160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-23046886-19a6-475a-adfd-81e00b9609f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:13.638583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 663/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:13.680663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269530a8-6ade-4ade-a25f-a60c4097d03e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:13.693432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269530a8-6ade-4ade-a25f-a60c4097d03e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:13.698706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413c3a5-435d-4327-abe9-12bd01b0b818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:13.699466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c3a5-435d-4327-abe9-12bd01b0b818 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:13.699623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c3a5-435d-4327-abe9-12bd01b0b818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:13.699903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413c3a5-435d-4327-abe9-12bd01b0b818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:13.709045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c3a5-435d-4327-abe9-12bd01b0b818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:13.710500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413c3a5-435d-4327-abe9-12bd01b0b818 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:13.719652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 686/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:19.034180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9a02f-137c-45dc-a8d6-300efcfce0af None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:19.034685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9a02f-137c-45dc-a8d6-300efcfce0af None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:19.035332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9a02f-137c-45dc-a8d6-300efcfce0af None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:19.037185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 664/1350] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:19.042293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e60c-4898-4b0f-95de-053a3ed22f73 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:19.043288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e60c-4898-4b0f-95de-053a3ed22f73 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:19.043758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e60c-4898-4b0f-95de-053a3ed22f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:19.113961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f5f9e60c-4898-4b0f-95de-053a3ed22f73 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:19.115660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f5f9e60c-4898-4b0f-95de-053a3ed22f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:19.190503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 687/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:08:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:23.493803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7ba5-d47d-4bb3-abb5-61f8ef80cc05 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:23.494354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7ba5-d47d-4bb3-abb5-61f8ef80cc05 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:23.494354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db7ba5-d47d-4bb3-abb5-61f8ef80cc05 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:23.495830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 665/1352] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:23.501238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1344a-1b85-4973-99d2-88fd409adf64 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:23.501649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1344a-1b85-4973-99d2-88fd409adf64 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:23.501786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1344a-1b85-4973-99d2-88fd409adf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:23.521382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7fa1344a-1b85-4973-99d2-88fd409adf64 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:23.522701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7fa1344a-1b85-4973-99d2-88fd409adf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:23.532699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 688/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:25.080461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb5e61-d6f9-4c06-be8c-36f94d4580b9 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:25.081060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb5e61-d6f9-4c06-be8c-36f94d4580b9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:25.081060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb5e61-d6f9-4c06-be8c-36f94d4580b9 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:25.082341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 666/1354] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:25.087744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442338-f53a-4346-822f-718b18fdbc67 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:25.088195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442338-f53a-4346-822f-718b18fdbc67 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:25.088289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442338-f53a-4346-822f-718b18fdbc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:25.107933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-be442338-f53a-4346-822f-718b18fdbc67 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:25.109175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-be442338-f53a-4346-822f-718b18fdbc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:25.119286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 689/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:08:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:28.813587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744b87-a135-4970-8528-cea6661fc028 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:28.814146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744b87-a135-4970-8528-cea6661fc028 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:28.814146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744b87-a135-4970-8528-cea6661fc028 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:28.815878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 667/1356] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:28.820958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0581-81d5-4f5f-a706-1433ce5814f6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:28.821823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0581-81d5-4f5f-a706-1433ce5814f6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:28.822062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0581-81d5-4f5f-a706-1433ce5814f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:28.841358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-eabd0581-81d5-4f5f-a706-1433ce5814f6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:28.842517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-eabd0581-81d5-4f5f-a706-1433ce5814f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:28.851714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 690/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:28.899727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8314e-0d1d-4612-aec5-b90a4f6393e7 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:28.899999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8314e-0d1d-4612-aec5-b90a4f6393e7 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:28.900289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8314e-0d1d-4612-aec5-b90a4f6393e7 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:28.901621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 668/1358] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 4 08:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:28.907605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff930-e27a-47e7-96d1-3e960441e5cc None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:28.908297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff930-e27a-47e7-96d1-3e960441e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:28.908678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaff930-e27a-47e7-96d1-3e960441e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:28.957007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bbaff930-e27a-47e7-96d1-3e960441e5cc None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:28.958306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bbaff930-e27a-47e7-96d1-3e960441e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:29.037494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 691/1359] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 4 08:08:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:29.046069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8314e-0d1d-4612-aec5-b90a4f6393e7 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:29.060876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8314e-0d1d-4612-aec5-b90a4f6393e7 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:29.067140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ef06c-51d8-4133-a331-5e9f2d626fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:29.067987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ef06c-51d8-4133-a331-5e9f2d626fb3 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:29.068430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ef06c-51d8-4133-a331-5e9f2d626fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:29.068856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ef06c-51d8-4133-a331-5e9f2d626fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:29.077990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ef06c-51d8-4133-a331-5e9f2d626fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:29.079859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ef06c-51d8-4133-a331-5e9f2d626fb3 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:29.101895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 669/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:31.527577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474117b2-b2b1-4876-9352-606d0d0a84cf None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:31.528150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474117b2-b2b1-4876-9352-606d0d0a84cf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:31.528150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474117b2-b2b1-4876-9352-606d0d0a84cf None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:31.529440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 692/1361] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:31.534914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf191-a1d2-4f61-9fd7-82c0535a6a23 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:31.535490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf191-a1d2-4f61-9fd7-82c0535a6a23 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:31.535490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cf191-a1d2-4f61-9fd7-82c0535a6a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:31.553366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8d9cf191-a1d2-4f61-9fd7-82c0535a6a23 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:31.554524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8d9cf191-a1d2-4f61-9fd7-82c0535a6a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:31.562708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 670/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:08:31.607003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474117b2-b2b1-4876-9352-606d0d0a84cf None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:31.621134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474117b2-b2b1-4876-9352-606d0d0a84cf None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:31.626602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b144ca9-2e0c-4796-aa7b-b92c35391a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:31.627345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144ca9-2e0c-4796-aa7b-b92c35391a39 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:31.627622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144ca9-2e0c-4796-aa7b-b92c35391a39 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:31.627894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144ca9-2e0c-4796-aa7b-b92c35391a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:31.636919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b144ca9-2e0c-4796-aa7b-b92c35391a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:31.638537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b144ca9-2e0c-4796-aa7b-b92c35391a39 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:31.647780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 693/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:34.171288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373599-e14c-410f-a20a-5299bc75a3c3 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:34.171846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373599-e14c-410f-a20a-5299bc75a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:34.171846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373599-e14c-410f-a20a-5299bc75a3c3 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:34.173343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 671/1364] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:34.178669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa626-af29-4184-8bd4-f40fffb83108 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:34.179496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa626-af29-4184-8bd4-f40fffb83108 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:34.179946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa626-af29-4184-8bd4-f40fffb83108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:34.201359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3a7fa626-af29-4184-8bd4-f40fffb83108 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:34.202790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3a7fa626-af29-4184-8bd4-f40fffb83108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:34.219351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 694/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:34.257592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe548-ae80-4651-bc45-a89041c6844a None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:34.257881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe548-ae80-4651-bc45-a89041c6844a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:34.258156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfe548-ae80-4651-bc45-a89041c6844a None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:34.259553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 672/1366] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 4 08:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:34.264812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b060cc-d5d8-4089-9c65-9e3cc3be1008 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:34.265095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b060cc-d5d8-4089-9c65-9e3cc3be1008 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:34.265368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b060cc-d5d8-4089-9c65-9e3cc3be1008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:34.283857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-75b060cc-d5d8-4089-9c65-9e3cc3be1008 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:34.285239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-75b060cc-d5d8-4089-9c65-9e3cc3be1008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:34.294585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 695/1367] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 4 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:34.302727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe548-ae80-4651-bc45-a89041c6844a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:34.316913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfe548-ae80-4651-bc45-a89041c6844a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:34.322124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021cfc0-cda3-440c-9876-040763e620f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:34.322752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021cfc0-cda3-440c-9876-040763e620f9 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:34.323065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021cfc0-cda3-440c-9876-040763e620f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:34.323339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021cfc0-cda3-440c-9876-040763e620f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:34.331328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021cfc0-cda3-440c-9876-040763e620f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:34.332900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021cfc0-cda3-440c-9876-040763e620f9 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:34.342215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 673/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:08:36.622673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5409b-61c2-478f-b5ab-e077362a49ba None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:36.623284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5409b-61c2-478f-b5ab-e077362a49ba None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:36.623284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5409b-61c2-478f-b5ab-e077362a49ba None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:36.624490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 696/1369] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:36.629876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f952d2-803e-4ae5-baf2-7f71ffa84d4f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:36.630316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f952d2-803e-4ae5-baf2-7f71ffa84d4f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:36.630441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f952d2-803e-4ae5-baf2-7f71ffa84d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:36.648568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-73f952d2-803e-4ae5-baf2-7f71ffa84d4f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:36.649775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-73f952d2-803e-4ae5-baf2-7f71ffa84d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:36.658912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 674/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:36.703854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5409b-61c2-478f-b5ab-e077362a49ba None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:36.718434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5409b-61c2-478f-b5ab-e077362a49ba None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:36.724192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095174d-1f3c-41e8-a99c-5556fc3eb1a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:36.724854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095174d-1f3c-41e8-a99c-5556fc3eb1a2 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:36.725161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095174d-1f3c-41e8-a99c-5556fc3eb1a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:36.725399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095174d-1f3c-41e8-a99c-5556fc3eb1a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:36.734941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095174d-1f3c-41e8-a99c-5556fc3eb1a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:36.736641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095174d-1f3c-41e8-a99c-5556fc3eb1a2 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:36.747968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 697/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:36.927759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299d0b-ef65-4836-a453-bba7d1df2d94 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:36.927985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299d0b-ef65-4836-a453-bba7d1df2d94 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:36.928201 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299d0b-ef65-4836-a453-bba7d1df2d94 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:36.929920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 675/1372] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:36.936185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff724372-2fea-4ed3-b2fa-9a806c016cde None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:36.936458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff724372-2fea-4ed3-b2fa-9a806c016cde None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:36.936758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff724372-2fea-4ed3-b2fa-9a806c016cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:36.959011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ff724372-2fea-4ed3-b2fa-9a806c016cde None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:36.960715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ff724372-2fea-4ed3-b2fa-9a806c016cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:36.970932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 698/1373] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:37.245484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da4f9-bde8-4cd8-bc04-f8cc1b915c76 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:37.245759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da4f9-bde8-4cd8-bc04-f8cc1b915c76 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:37.246299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da4f9-bde8-4cd8-bc04-f8cc1b915c76 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:37.247689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 676/1374] 10.222.0.59 () {54 vars in 963 bytes} [Wed May 4 08:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:37.252883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2af693-6a98-4964-b0a9-083f6d111bef None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:37.253289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2af693-6a98-4964-b0a9-083f6d111bef None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:37.253804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2af693-6a98-4964-b0a9-083f6d111bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:37.304139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-aa2af693-6a98-4964-b0a9-083f6d111bef None None] MFA Rules not processed for user `df742434fdab408581ad24749c6c9331`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:37.305442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-aa2af693-6a98-4964-b0a9-083f6d111bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:37.362490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 699/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Wed May 4 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:37.371134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da4f9-bde8-4cd8-bc04-f8cc1b915c76 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:37.382001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da4f9-bde8-4cd8-bc04-f8cc1b915c76 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:37.388966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0265a3-194e-47a5-a1e6-928bc2543aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:37.389732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0265a3-194e-47a5-a1e6-928bc2543aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:37.390132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0265a3-194e-47a5-a1e6-928bc2543aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:37.390501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0265a3-194e-47a5-a1e6-928bc2543aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:37.400136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0265a3-194e-47a5-a1e6-928bc2543aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:37.401759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0265a3-194e-47a5-a1e6-928bc2543aa0 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:37.412307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 677/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:39.014041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e224-0552-42b5-88dd-6f974c375e31 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:39.015019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e224-0552-42b5-88dd-6f974c375e31 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:39.015302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e224-0552-42b5-88dd-6f974c375e31 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:39.016802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 700/1377] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:39.022626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24fe15-c4d8-49b9-956d-7678656c2e70 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:39.023151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24fe15-c4d8-49b9-956d-7678656c2e70 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:39.023262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24fe15-c4d8-49b9-956d-7678656c2e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:39.042162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fb24fe15-c4d8-49b9-956d-7678656c2e70 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:39.043404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fb24fe15-c4d8-49b9-956d-7678656c2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:39.052478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 678/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:39.099719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6e224-0552-42b5-88dd-6f974c375e31 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:39.115219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6e224-0552-42b5-88dd-6f974c375e31 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:39.121952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee908b9-9678-4b22-a42e-6a84bb9d3f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:39.122609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee908b9-9678-4b22-a42e-6a84bb9d3f31 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:39.122898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee908b9-9678-4b22-a42e-6a84bb9d3f31 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:39.123177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee908b9-9678-4b22-a42e-6a84bb9d3f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:39.133225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee908b9-9678-4b22-a42e-6a84bb9d3f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:39.134826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee908b9-9678-4b22-a42e-6a84bb9d3f31 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:39.145198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 701/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:41.429100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f437a-6a07-41f9-85f6-0c6d86083c7d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:41.429657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f437a-6a07-41f9-85f6-0c6d86083c7d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:41.430068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f437a-6a07-41f9-85f6-0c6d86083c7d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:41.431904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 679/1380] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:41.437270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b7624-f419-4df3-b446-473ad644bc9a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:41.438054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b7624-f419-4df3-b446-473ad644bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:41.438155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b7624-f419-4df3-b446-473ad644bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:41.456502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9d0b7624-f419-4df3-b446-473ad644bc9a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:41.457683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9d0b7624-f419-4df3-b446-473ad644bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:41.465851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 702/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:41.509827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f437a-6a07-41f9-85f6-0c6d86083c7d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:41.526152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f437a-6a07-41f9-85f6-0c6d86083c7d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:41.532332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a0400-019c-4372-9b0e-bf862ef8f324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:41.533205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0400-019c-4372-9b0e-bf862ef8f324 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:41.533608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0400-019c-4372-9b0e-bf862ef8f324 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:41.533979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a0400-019c-4372-9b0e-bf862ef8f324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:41.542795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a0400-019c-4372-9b0e-bf862ef8f324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:41.544499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a0400-019c-4372-9b0e-bf862ef8f324 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:41.554426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 680/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:43.822242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106f92-576d-4a30-a194-1f3ac25ffaa9 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:43.823208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106f92-576d-4a30-a194-1f3ac25ffaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:43.823208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106f92-576d-4a30-a194-1f3ac25ffaa9 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:43.827781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 703/1383] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:43.830283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82426778-8b8f-4723-9469-5b37beeab57e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:43.830873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82426778-8b8f-4723-9469-5b37beeab57e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:43.830873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82426778-8b8f-4723-9469-5b37beeab57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:43.850538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-82426778-8b8f-4723-9469-5b37beeab57e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:43.851908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-82426778-8b8f-4723-9469-5b37beeab57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:43.861597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 681/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:43.902869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106f92-576d-4a30-a194-1f3ac25ffaa9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:43.918719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106f92-576d-4a30-a194-1f3ac25ffaa9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:43.924965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b45424-0fca-4d78-ae07-29b852220431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:43.925612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b45424-0fca-4d78-ae07-29b852220431 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:43.925892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b45424-0fca-4d78-ae07-29b852220431 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:43.926158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b45424-0fca-4d78-ae07-29b852220431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:43.935092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b45424-0fca-4d78-ae07-29b852220431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:43.936752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b45424-0fca-4d78-ae07-29b852220431 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:43.947125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 704/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:46.180093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596ec9-5057-4ee4-9d60-181a19ba4bb3 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:46.180648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596ec9-5057-4ee4-9d60-181a19ba4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:46.180945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596ec9-5057-4ee4-9d60-181a19ba4bb3 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:46.182843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 682/1386] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:46.190690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823879f-7fce-4ecc-a3ff-b0a3188d04b9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:46.191368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823879f-7fce-4ecc-a3ff-b0a3188d04b9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:46.191368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823879f-7fce-4ecc-a3ff-b0a3188d04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:46.210376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c823879f-7fce-4ecc-a3ff-b0a3188d04b9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:46.211645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c823879f-7fce-4ecc-a3ff-b0a3188d04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:46.220748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 705/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:08:46.268774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596ec9-5057-4ee4-9d60-181a19ba4bb3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:46.285940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596ec9-5057-4ee4-9d60-181a19ba4bb3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:46.291513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c98027-24ae-46b3-8687-a2c1ac90bd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:46.292205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c98027-24ae-46b3-8687-a2c1ac90bd6e service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:46.292439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c98027-24ae-46b3-8687-a2c1ac90bd6e service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:46.292708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c98027-24ae-46b3-8687-a2c1ac90bd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:46.300956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c98027-24ae-46b3-8687-a2c1ac90bd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:46.302562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c98027-24ae-46b3-8687-a2c1ac90bd6e service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:46.311722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 683/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:48.543855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336b471-58c1-4223-8947-11bbff283127 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:48.544575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336b471-58c1-4223-8947-11bbff283127 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:48.544575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336b471-58c1-4223-8947-11bbff283127 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:48.546113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 706/1389] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:48.551523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f98f0-e46d-48a9-84a7-9c7b2bc18a18 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:48.551970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f98f0-e46d-48a9-84a7-9c7b2bc18a18 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:48.552104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f98f0-e46d-48a9-84a7-9c7b2bc18a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:48.571134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-bb1f98f0-e46d-48a9-84a7-9c7b2bc18a18 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:48.573073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bb1f98f0-e46d-48a9-84a7-9c7b2bc18a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:48.583288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 684/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:48.639486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336b471-58c1-4223-8947-11bbff283127 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:48.655423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336b471-58c1-4223-8947-11bbff283127 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:48.661643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71f5a1-2fa5-45ed-b990-418bdda302f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:48.662314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71f5a1-2fa5-45ed-b990-418bdda302f0 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:48.662607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71f5a1-2fa5-45ed-b990-418bdda302f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:48.662904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71f5a1-2fa5-45ed-b990-418bdda302f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:48.671590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71f5a1-2fa5-45ed-b990-418bdda302f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:48.673324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df71f5a1-2fa5-45ed-b990-418bdda302f0 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:48.682684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 707/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:51.094402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca097-c31f-461e-930d-20c83c511803 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:51.095206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca097-c31f-461e-930d-20c83c511803 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:51.095206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca097-c31f-461e-930d-20c83c511803 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:51.096333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 685/1392] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:51.101676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e0d3-b15f-4208-b667-8f4b400dfaff None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:51.102141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e0d3-b15f-4208-b667-8f4b400dfaff None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:51.102247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715e0d3-b15f-4208-b667-8f4b400dfaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:51.120414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4715e0d3-b15f-4208-b667-8f4b400dfaff None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:51.121597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4715e0d3-b15f-4208-b667-8f4b400dfaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:51.130032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 708/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:51.173213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca097-c31f-461e-930d-20c83c511803 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:51.188463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca097-c31f-461e-930d-20c83c511803 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:51.194287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a506f2-9d48-4478-88ca-e0650c1692af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:51.194982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a506f2-9d48-4478-88ca-e0650c1692af service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:51.195275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a506f2-9d48-4478-88ca-e0650c1692af service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:51.195525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a506f2-9d48-4478-88ca-e0650c1692af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:51.203839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a506f2-9d48-4478-88ca-e0650c1692af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:51.205439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a506f2-9d48-4478-88ca-e0650c1692af service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:51.214945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 686/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:52.936076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d662-9420-4adb-8e95-c1586a401f1d None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:52.936676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d662-9420-4adb-8e95-c1586a401f1d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:52.936676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2d662-9420-4adb-8e95-c1586a401f1d None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:52.938356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 709/1395] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:52.943890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52b6f-5a55-48a4-99b6-8a57b03720d3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:52.944330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52b6f-5a55-48a4-99b6-8a57b03720d3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:52.944548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52b6f-5a55-48a4-99b6-8a57b03720d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:52.963497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a0e52b6f-5a55-48a4-99b6-8a57b03720d3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:52.964685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a0e52b6f-5a55-48a4-99b6-8a57b03720d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:52.973053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 687/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:53.028793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a131-2392-405a-aade-1d2f1ab15821 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.029081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a131-2392-405a-aade-1d2f1ab15821 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.029354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a131-2392-405a-aade-1d2f1ab15821 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.030729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 710/1397] 10.222.0.59 () {54 vars in 962 bytes} [Wed May 4 08:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:53.035917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35167032-5899-4956-a486-321ab11e4d63 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.036202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35167032-5899-4956-a486-321ab11e4d63 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.036472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35167032-5899-4956-a486-321ab11e4d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.090436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-35167032-5899-4956-a486-321ab11e4d63 None None] MFA Rules not processed for user `5a8dcc7e7ecb48c7b89845bbd9babbeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:53.091745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-35167032-5899-4956-a486-321ab11e4d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:53.153107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 688/1398] 10.222.0.59 () {58 vars in 1059 bytes} [Wed May 4 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:53.160769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a131-2392-405a-aade-1d2f1ab15821 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:53.171559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a131-2392-405a-aade-1d2f1ab15821 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:53.175193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bc73f-4f24-4229-a0de-afbe9d3f5315 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:53.175833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bc73f-4f24-4229-a0de-afbe9d3f5315 service glance] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.176109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bc73f-4f24-4229-a0de-afbe9d3f5315 service glance] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.176378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bc73f-4f24-4229-a0de-afbe9d3f5315 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.185425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bc73f-4f24-4229-a0de-afbe9d3f5315 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:53.186994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bc73f-4f24-4229-a0de-afbe9d3f5315 service glance] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:53.196748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 711/1399] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:53.475699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783fbc-543c-4ab9-ab68-ac15c90c5892 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.475909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783fbc-543c-4ab9-ab68-ac15c90c5892 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.476167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd783fbc-543c-4ab9-ab68-ac15c90c5892 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.477576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 689/1400] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:53.483913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fce578-7e28-4a27-8343-0fe0fccfdb86 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.484201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fce578-7e28-4a27-8343-0fe0fccfdb86 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.484475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fce578-7e28-4a27-8343-0fe0fccfdb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.502097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-57fce578-7e28-4a27-8343-0fe0fccfdb86 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:53.503425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-57fce578-7e28-4a27-8343-0fe0fccfdb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:53.511197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 712/1401] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:08:53.555377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783fbc-543c-4ab9-ab68-ac15c90c5892 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:53.571097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd783fbc-543c-4ab9-ab68-ac15c90c5892 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:53.577634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953d7f9-f7f3-48e4-842e-7657fe6cd008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:53.578438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953d7f9-f7f3-48e4-842e-7657fe6cd008 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.578723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953d7f9-f7f3-48e4-842e-7657fe6cd008 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.582869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953d7f9-f7f3-48e4-842e-7657fe6cd008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.591561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953d7f9-f7f3-48e4-842e-7657fe6cd008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:53.593134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953d7f9-f7f3-48e4-842e-7657fe6cd008 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:53.603977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 690/1402] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:08:53.620820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c66a-af31-4572-972b-6933a80d5f2e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.621103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c66a-af31-4572-972b-6933a80d5f2e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.621390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c66a-af31-4572-972b-6933a80d5f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.671674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8549c66a-af31-4572-972b-6933a80d5f2e None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:53.672909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8549c66a-af31-4572-972b-6933a80d5f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:53.743879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 713/1403] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:53.790173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee3488-e463-43d0-a5fe-b6a900c8d9f0 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.790466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee3488-e463-43d0-a5fe-b6a900c8d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.790735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee3488-e463-43d0-a5fe-b6a900c8d9f0 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.792151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 691/1404] 10.222.0.59 () {54 vars in 942 bytes} [Wed May 4 08:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:53.799624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6fcc-2bd2-4b00-8f0e-b54dfae2dc55 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.799939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6fcc-2bd2-4b00-8f0e-b54dfae2dc55 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.800216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6fcc-2bd2-4b00-8f0e-b54dfae2dc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.852857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-908b6fcc-2bd2-4b00-8f0e-b54dfae2dc55 None None] MFA Rules not processed for user `fce6f00e1a97411fa0c248a8f08b2256`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:53.854038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-908b6fcc-2bd2-4b00-8f0e-b54dfae2dc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:53.927000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 714/1405] 10.222.0.59 () {58 vars in 1039 bytes} [Wed May 4 08:08:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:08:53.936549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee3488-e463-43d0-a5fe-b6a900c8d9f0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:53.950557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee3488-e463-43d0-a5fe-b6a900c8d9f0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:53.955623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a509d7-d8d9-4aed-b439-8cb48e6677f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:53.956259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a509d7-d8d9-4aed-b439-8cb48e6677f8 service swift] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:53.956538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a509d7-d8d9-4aed-b439-8cb48e6677f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:53.956808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a509d7-d8d9-4aed-b439-8cb48e6677f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:53.965103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a509d7-d8d9-4aed-b439-8cb48e6677f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:53.966647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a509d7-d8d9-4aed-b439-8cb48e6677f8 service swift] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:53.974766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 692/1406] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:08:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:08:55.868788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad3de2-c264-4a55-97c0-3496c075aed2 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:55.868788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad3de2-c264-4a55-97c0-3496c075aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:55.868788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad3de2-c264-4a55-97c0-3496c075aed2 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:55.878667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f7a9-c659-46a3-85a3-37bceddedf99 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:55.880140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f7a9-c659-46a3-85a3-37bceddedf99 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:55.880913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83f7a9-c659-46a3-85a3-37bceddedf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:55.884095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 715/1407] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:08:55 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:08:55.925636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-ea83f7a9-c659-46a3-85a3-37bceddedf99 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:08:55.928097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ea83f7a9-c659-46a3-85a3-37bceddedf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:08:55.946799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 693/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:08:56.003837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad3de2-c264-4a55-97c0-3496c075aed2 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:08:56.018135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad3de2-c264-4a55-97c0-3496c075aed2 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:08:56.023704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a8996-4e62-43d3-a873-2fc5ac37c68b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:08:56.024343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a8996-4e62-43d3-a873-2fc5ac37c68b service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:08:56.024625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a8996-4e62-43d3-a873-2fc5ac37c68b service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:08:56.024897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a8996-4e62-43d3-a873-2fc5ac37c68b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:08:56.033925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a8996-4e62-43d3-a873-2fc5ac37c68b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:08:56.035570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a8996-4e62-43d3-a873-2fc5ac37c68b service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:08:56.044981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 716/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:17.245933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d33b32-0b7c-49eb-a0a1-268eb4b1d2fb None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:17.246601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d33b32-0b7c-49eb-a0a1-268eb4b1d2fb None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:17.246601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d33b32-0b7c-49eb-a0a1-268eb4b1d2fb None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:17.247882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 694/1410] 10.222.0.59 () {54 vars in 918 bytes} [Wed May 4 08:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:17.253604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503fbce-6562-44d4-a16f-c520c2001cf8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:17.254058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503fbce-6562-44d4-a16f-c520c2001cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:17.254167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503fbce-6562-44d4-a16f-c520c2001cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:17.273369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3503fbce-6562-44d4-a16f-c520c2001cf8 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:17.274562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3503fbce-6562-44d4-a16f-c520c2001cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:17.285730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 717/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Wed May 4 08:09:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:17.307865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e9995-dd95-4e58-83a5-5a09998e3d2a None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:17.308150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e9995-dd95-4e58-83a5-5a09998e3d2a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:17.308422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e9995-dd95-4e58-83a5-5a09998e3d2a None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:17.309837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 695/1412] 10.222.0.59 () {54 vars in 918 bytes} [Wed May 4 08:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:17.315877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d6a9-661c-4afa-a561-cd12e9239d6c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:17.316166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d6a9-661c-4afa-a561-cd12e9239d6c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:17.316439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080d6a9-661c-4afa-a561-cd12e9239d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:17.335188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2080d6a9-661c-4afa-a561-cd12e9239d6c None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:17.336365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2080d6a9-661c-4afa-a561-cd12e9239d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:17.345919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 718/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Wed May 4 08:09:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:09:20.054682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00405557-7cd9-4cc7-9c9b-b4abd59ea761 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:20.055634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00405557-7cd9-4cc7-9c9b-b4abd59ea761 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:20.055634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00405557-7cd9-4cc7-9c9b-b4abd59ea761 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:20.057737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:20.066853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3eee-9d7b-4ac3-870c-6a83d47148b0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:20.067614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3eee-9d7b-4ac3-870c-6a83d47148b0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:20.067786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3eee-9d7b-4ac3-870c-6a83d47148b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:20.090548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-95ae3eee-9d7b-4ac3-870c-6a83d47148b0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:20.091762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-95ae3eee-9d7b-4ac3-870c-6a83d47148b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:20.100422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:20.143127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00405557-7cd9-4cc7-9c9b-b4abd59ea761 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:20.158675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00405557-7cd9-4cc7-9c9b-b4abd59ea761 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:20.165164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a26c0-1217-42ef-a445-c3b1d9856fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:20.165781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a26c0-1217-42ef-a445-c3b1d9856fad service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:20.166066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a26c0-1217-42ef-a445-c3b1d9856fad service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:20.166335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a26c0-1217-42ef-a445-c3b1d9856fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:20.175789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a26c0-1217-42ef-a445-c3b1d9856fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:20.178248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a26c0-1217-42ef-a445-c3b1d9856fad service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:20.191928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 697/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:21.487141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38b4ea-e976-40fb-b75a-36c45e606d95 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:21.488043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38b4ea-e976-40fb-b75a-36c45e606d95 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:21.488043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38b4ea-e976-40fb-b75a-36c45e606d95 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:21.490205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:21.496238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e45f-d0d4-4dbc-b7c3-d9103b756d4f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:21.497006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e45f-d0d4-4dbc-b7c3-d9103b756d4f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:21.497181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699e45f-d0d4-4dbc-b7c3-d9103b756d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:21.523512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1699e45f-d0d4-4dbc-b7c3-d9103b756d4f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:21.524696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1699e45f-d0d4-4dbc-b7c3-d9103b756d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:21.532863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:21.698615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38b4ea-e976-40fb-b75a-36c45e606d95 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:21.721645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38b4ea-e976-40fb-b75a-36c45e606d95 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:21.728340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6f166-83a4-4628-90e2-26449ef38ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:21.728967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f166-83a4-4628-90e2-26449ef38ccb service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:21.729243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f166-83a4-4628-90e2-26449ef38ccb service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:21.729504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6f166-83a4-4628-90e2-26449ef38ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:21.737988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6f166-83a4-4628-90e2-26449ef38ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:21.739622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6f166-83a4-4628-90e2-26449ef38ccb service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:21.749297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 721/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:23.042827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b559-31dc-47d4-88dd-784186e74671 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:23.043454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b559-31dc-47d4-88dd-784186e74671 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:23.043454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200b559-31dc-47d4-88dd-784186e74671 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:23.045496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:23.051461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b6e7e-d0d1-4b23-ae84-d725291b16a2 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:23.051852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b6e7e-d0d1-4b23-ae84-d725291b16a2 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:23.051990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b6e7e-d0d1-4b23-ae84-d725291b16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:23.072134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-910b6e7e-d0d1-4b23-ae84-d725291b16a2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:23.073288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-910b6e7e-d0d1-4b23-ae84-d725291b16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:23.081973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:23.232158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200b559-31dc-47d4-88dd-784186e74671 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:23.255513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200b559-31dc-47d4-88dd-784186e74671 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:23.262109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a047b4c-38ff-47a3-9003-8ea24253fed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:23.262776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047b4c-38ff-47a3-9003-8ea24253fed5 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:23.263137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047b4c-38ff-47a3-9003-8ea24253fed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:23.263378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a047b4c-38ff-47a3-9003-8ea24253fed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:23.271707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a047b4c-38ff-47a3-9003-8ea24253fed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:23.273275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a047b4c-38ff-47a3-9003-8ea24253fed5 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:23.282842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 700/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:24.511574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fc0b-93b5-400a-8972-7b8cc7da792e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:24.512486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fc0b-93b5-400a-8972-7b8cc7da792e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:24.512486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fc0b-93b5-400a-8972-7b8cc7da792e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:24.514695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:24.521165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a5ee-efa4-4ad8-b09c-5a7f6b6bf835 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:24.521584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a5ee-efa4-4ad8-b09c-5a7f6b6bf835 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:24.521739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a5ee-efa4-4ad8-b09c-5a7f6b6bf835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:24.549226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-60c3a5ee-efa4-4ad8-b09c-5a7f6b6bf835 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:24.551139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-60c3a5ee-efa4-4ad8-b09c-5a7f6b6bf835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:24.564368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:24.714773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fc0b-93b5-400a-8972-7b8cc7da792e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:24.730473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fc0b-93b5-400a-8972-7b8cc7da792e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:24.740203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6b264-27aa-4b31-927a-b12b07bfef40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:24.741397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b264-27aa-4b31-927a-b12b07bfef40 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:24.741852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b264-27aa-4b31-927a-b12b07bfef40 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:24.742289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b264-27aa-4b31-927a-b12b07bfef40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:24.754112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6b264-27aa-4b31-927a-b12b07bfef40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:24.755754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6b264-27aa-4b31-927a-b12b07bfef40 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:24.765225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 724/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:25.987685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf766-9fb9-4b4c-9c14-4f191ab56d75 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:25.988278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf766-9fb9-4b4c-9c14-4f191ab56d75 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:25.988278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf766-9fb9-4b4c-9c14-4f191ab56d75 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:25.989634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:25.995075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e01689-c6b1-4556-aa8e-25c91921e7b9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:25.995592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e01689-c6b1-4556-aa8e-25c91921e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:25.995592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e01689-c6b1-4556-aa8e-25c91921e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:26.013519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-59e01689-c6b1-4556-aa8e-25c91921e7b9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:26.014696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-59e01689-c6b1-4556-aa8e-25c91921e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:26.022723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:26.172971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf766-9fb9-4b4c-9c14-4f191ab56d75 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:26.191864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf766-9fb9-4b4c-9c14-4f191ab56d75 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:26.198617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201c00f-a87b-497d-8c6f-75b952c614f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:26.199267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c00f-a87b-497d-8c6f-75b952c614f8 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:26.199562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c00f-a87b-497d-8c6f-75b952c614f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:26.199834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201c00f-a87b-497d-8c6f-75b952c614f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:26.207878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201c00f-a87b-497d-8c6f-75b952c614f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:26.209544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201c00f-a87b-497d-8c6f-75b952c614f8 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:26.218561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 703/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:27.426285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24af4-24f8-4469-b272-1bdac96f382e None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:27.427013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24af4-24f8-4469-b272-1bdac96f382e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:27.427107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24af4-24f8-4469-b272-1bdac96f382e None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:27.429377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:27.434398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeda80a-7e28-4ed6-91f8-c9bddad8f065 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:27.434846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeda80a-7e28-4ed6-91f8-c9bddad8f065 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:27.434983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeda80a-7e28-4ed6-91f8-c9bddad8f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:27.459039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fdeda80a-7e28-4ed6-91f8-c9bddad8f065 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:27.460218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fdeda80a-7e28-4ed6-91f8-c9bddad8f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:27.468611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:27.619409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24af4-24f8-4469-b272-1bdac96f382e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:27.644299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24af4-24f8-4469-b272-1bdac96f382e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:27.653340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771a394-4ac7-4e46-82cc-e9f93dd83e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:27.654246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a394-4ac7-4e46-82cc-e9f93dd83e59 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:27.654606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a394-4ac7-4e46-82cc-e9f93dd83e59 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:27.654953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a394-4ac7-4e46-82cc-e9f93dd83e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:27.664355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a394-4ac7-4e46-82cc-e9f93dd83e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:27.665891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a394-4ac7-4e46-82cc-e9f93dd83e59 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:27.675952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 727/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:28.867125 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de36aa-acf2-4be8-b472-7ac287dfab5c None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:28.867886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de36aa-acf2-4be8-b472-7ac287dfab5c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:28.867886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de36aa-acf2-4be8-b472-7ac287dfab5c None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:28.870141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:28.876141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777dde3-78ec-4c76-95fd-2ed49fd4bac3 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:28.876901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777dde3-78ec-4c76-95fd-2ed49fd4bac3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:28.877092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777dde3-78ec-4c76-95fd-2ed49fd4bac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:28.901060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2777dde3-78ec-4c76-95fd-2ed49fd4bac3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:28.902261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2777dde3-78ec-4c76-95fd-2ed49fd4bac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:28.911254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:29.060515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de36aa-acf2-4be8-b472-7ac287dfab5c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:29.078787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de36aa-acf2-4be8-b472-7ac287dfab5c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:29.084762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865b850-5385-4795-a2f2-9dffea585324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:29.085376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865b850-5385-4795-a2f2-9dffea585324 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:29.085639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865b850-5385-4795-a2f2-9dffea585324 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:29.085916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865b850-5385-4795-a2f2-9dffea585324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:29.095249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865b850-5385-4795-a2f2-9dffea585324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:29.097868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865b850-5385-4795-a2f2-9dffea585324 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:29.112694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 706/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:30.293039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963efea4-6039-430d-961a-79dfdef83643 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:30.293632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963efea4-6039-430d-961a-79dfdef83643 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:30.293632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963efea4-6039-430d-961a-79dfdef83643 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:30.294968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:30.301190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9bbd-7ddc-46f7-80e1-d94d84e87fd6 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:30.301575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9bbd-7ddc-46f7-80e1-d94d84e87fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:30.301744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9bbd-7ddc-46f7-80e1-d94d84e87fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:30.321914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2f3c9bbd-7ddc-46f7-80e1-d94d84e87fd6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:30.323207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2f3c9bbd-7ddc-46f7-80e1-d94d84e87fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:30.333589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:30.485764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963efea4-6039-430d-961a-79dfdef83643 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:30.503572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963efea4-6039-430d-961a-79dfdef83643 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:30.510583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759e10c-df91-4a5a-b172-eb798c47767e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:30.511250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e10c-df91-4a5a-b172-eb798c47767e service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:30.511526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e10c-df91-4a5a-b172-eb798c47767e service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:30.511798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759e10c-df91-4a5a-b172-eb798c47767e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:30.520644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759e10c-df91-4a5a-b172-eb798c47767e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:30.522443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759e10c-df91-4a5a-b172-eb798c47767e service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:30.532701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 730/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:31.738192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34ff7e-46ea-49c5-bd70-198b5a3714de None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:31.739129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34ff7e-46ea-49c5-bd70-198b5a3714de None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:31.739129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34ff7e-46ea-49c5-bd70-198b5a3714de None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:31.741303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:31.749450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad734-3852-4272-aba2-17b5db734ade None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:31.749922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad734-3852-4272-aba2-17b5db734ade None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:31.750118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad734-3852-4272-aba2-17b5db734ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:31.771228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ea1ad734-3852-4272-aba2-17b5db734ade None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:31.772340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ea1ad734-3852-4272-aba2-17b5db734ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:31.781641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:31.932250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34ff7e-46ea-49c5-bd70-198b5a3714de None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:31.949581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34ff7e-46ea-49c5-bd70-198b5a3714de None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:31.956096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705e29-fb29-4d74-8aaa-9efe5177e3cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:31.956788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705e29-fb29-4d74-8aaa-9efe5177e3cf service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:31.957098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705e29-fb29-4d74-8aaa-9efe5177e3cf service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:31.957400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705e29-fb29-4d74-8aaa-9efe5177e3cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:31.966122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1705e29-fb29-4d74-8aaa-9efe5177e3cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:31.967736 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1705e29-fb29-4d74-8aaa-9efe5177e3cf service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:31.977307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 709/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:34.076030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192a4b9-a48f-42fc-b0d6-c53e38e1ca91 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:34.076889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192a4b9-a48f-42fc-b0d6-c53e38e1ca91 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:34.076889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192a4b9-a48f-42fc-b0d6-c53e38e1ca91 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:34.078786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:34.084366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c2e8-f299-48a9-bb90-1d7ad45e1a0c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:34.084824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c2e8-f299-48a9-bb90-1d7ad45e1a0c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:34.084945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086c2e8-f299-48a9-bb90-1d7ad45e1a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:34.103345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-e086c2e8-f299-48a9-bb90-1d7ad45e1a0c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:34.104543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e086c2e8-f299-48a9-bb90-1d7ad45e1a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:34.113699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:34.157449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192a4b9-a48f-42fc-b0d6-c53e38e1ca91 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:34.171330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192a4b9-a48f-42fc-b0d6-c53e38e1ca91 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:34.175330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f5bbd-c069-4446-ab20-1edc6de2cb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:34.175960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f5bbd-c069-4446-ab20-1edc6de2cb4f service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:34.176238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f5bbd-c069-4446-ab20-1edc6de2cb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:34.176535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f5bbd-c069-4446-ab20-1edc6de2cb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:34.185733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f5bbd-c069-4446-ab20-1edc6de2cb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:34.187558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f5bbd-c069-4446-ab20-1edc6de2cb4f service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:34.197202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 733/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:36.578360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2f54-a201-4137-8d04-781e0372044f None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:36.579261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2f54-a201-4137-8d04-781e0372044f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:36.579261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2f54-a201-4137-8d04-781e0372044f None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:36.581376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:36.587849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2126f5-671c-43a6-adc6-8c30daa072c8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:36.588590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2126f5-671c-43a6-adc6-8c30daa072c8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:36.588732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2126f5-671c-43a6-adc6-8c30daa072c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:36.614441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fe2126f5-671c-43a6-adc6-8c30daa072c8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:36.615689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fe2126f5-671c-43a6-adc6-8c30daa072c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:36.624104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:36.662288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2f54-a201-4137-8d04-781e0372044f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:36.664204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1d5c2f54-a201-4137-8d04-781e0372044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:36.689228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c2f54-a201-4137-8d04-781e0372044f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:36.693731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278115f-eeb9-4ec1-a67e-740c88600ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:36.694368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278115f-eeb9-4ec1-a67e-740c88600ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:36.694642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278115f-eeb9-4ec1-a67e-740c88600ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:36.694930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278115f-eeb9-4ec1-a67e-740c88600ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:36.705267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278115f-eeb9-4ec1-a67e-740c88600ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:36.706689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278115f-eeb9-4ec1-a67e-740c88600ecd service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:36.716940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 712/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:39.340079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447f2a-080e-4761-8c4c-fdddf073d86d None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:39.341091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447f2a-080e-4761-8c4c-fdddf073d86d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:39.341091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a447f2a-080e-4761-8c4c-fdddf073d86d None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:39.343389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:39.350117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e80f-1afd-47ea-bb55-8750c594fea0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:39.350574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e80f-1afd-47ea-bb55-8750c594fea0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:39.350689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e80f-1afd-47ea-bb55-8750c594fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:39.372524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5d42e80f-1afd-47ea-bb55-8750c594fea0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:39.373705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5d42e80f-1afd-47ea-bb55-8750c594fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:39.383045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:39.421021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447f2a-080e-4761-8c4c-fdddf073d86d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:39.433222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a447f2a-080e-4761-8c4c-fdddf073d86d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:39.437917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a3222-3188-4dee-a2b2-3741359da868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:39.438556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3222-3188-4dee-a2b2-3741359da868 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:39.438834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3222-3188-4dee-a2b2-3741359da868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:39.439221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a3222-3188-4dee-a2b2-3741359da868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:39.454453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3222-3188-4dee-a2b2-3741359da868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:39.455903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a3222-3188-4dee-a2b2-3741359da868 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:39.465391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 736/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:41.873178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646021b-42dd-45e3-bff1-4e714ef57396 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:41.874038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646021b-42dd-45e3-bff1-4e714ef57396 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:41.874038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646021b-42dd-45e3-bff1-4e714ef57396 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:41.876294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:41.881952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d20be-098a-4a95-a9ee-730e57b72a43 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:41.882409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d20be-098a-4a95-a9ee-730e57b72a43 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:41.882506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d20be-098a-4a95-a9ee-730e57b72a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:41.901057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d71d20be-098a-4a95-a9ee-730e57b72a43 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:41.902242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d71d20be-098a-4a95-a9ee-730e57b72a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:41.910680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:41.952746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646021b-42dd-45e3-bff1-4e714ef57396 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:41.970919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646021b-42dd-45e3-bff1-4e714ef57396 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:41.975501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b6707-9b1b-45e1-b45e-e9f2be8c1790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:41.976135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6707-9b1b-45e1-b45e-e9f2be8c1790 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:41.976411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6707-9b1b-45e1-b45e-e9f2be8c1790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:41.976683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b6707-9b1b-45e1-b45e-e9f2be8c1790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:41.988384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b6707-9b1b-45e1-b45e-e9f2be8c1790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:41.989804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b6707-9b1b-45e1-b45e-e9f2be8c1790 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:42.003889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 715/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:44.357733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d722e-f46c-4407-a1a6-e3ac22018002 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:44.358344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d722e-f46c-4407-a1a6-e3ac22018002 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:44.358344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d722e-f46c-4407-a1a6-e3ac22018002 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:44.359740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:44.365413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc250-9d0a-4f67-9b67-ca65ade5d114 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:44.365839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc250-9d0a-4f67-9b67-ca65ade5d114 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:44.365948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc250-9d0a-4f67-9b67-ca65ade5d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:44.384788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-925dc250-9d0a-4f67-9b67-ca65ade5d114 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:44.385980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-925dc250-9d0a-4f67-9b67-ca65ade5d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:44.395600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:44.435088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d722e-f46c-4407-a1a6-e3ac22018002 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:44.447641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d722e-f46c-4407-a1a6-e3ac22018002 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:44.451653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877625c9-a964-427c-ac44-d7359257e6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:44.452287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877625c9-a964-427c-ac44-d7359257e6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:44.452585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877625c9-a964-427c-ac44-d7359257e6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:44.452833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877625c9-a964-427c-ac44-d7359257e6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:44.462247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877625c9-a964-427c-ac44-d7359257e6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:44.463722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877625c9-a964-427c-ac44-d7359257e6dd service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:44.473127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 739/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:46.772089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c502-be17-4b82-9bf1-3c47c850a082 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:46.772989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c502-be17-4b82-9bf1-3c47c850a082 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:46.772989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25c502-be17-4b82-9bf1-3c47c850a082 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:46.775057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:46.782802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee527cf4-68a7-4477-9ab1-9c2559960f8e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:46.783300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee527cf4-68a7-4477-9ab1-9c2559960f8e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:46.783415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee527cf4-68a7-4477-9ab1-9c2559960f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:46.801720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ee527cf4-68a7-4477-9ab1-9c2559960f8e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:46.802977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ee527cf4-68a7-4477-9ab1-9c2559960f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:46.814280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:46.852487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c502-be17-4b82-9bf1-3c47c850a082 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:46.867636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25c502-be17-4b82-9bf1-3c47c850a082 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:46.873696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49b8cf-1c2a-49e8-825b-e1e914d0122d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:46.874605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b8cf-1c2a-49e8-825b-e1e914d0122d service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:46.874968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b8cf-1c2a-49e8-825b-e1e914d0122d service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:46.875338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49b8cf-1c2a-49e8-825b-e1e914d0122d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:46.890054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b8cf-1c2a-49e8-825b-e1e914d0122d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:46.891552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49b8cf-1c2a-49e8-825b-e1e914d0122d service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:46.901247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 718/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:49.259658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0aa4c-6ad4-451c-90dd-328391fff23a None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:49.260259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0aa4c-6ad4-451c-90dd-328391fff23a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:49.260259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0aa4c-6ad4-451c-90dd-328391fff23a None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:49.261831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:49.267751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ecadf-700d-40a4-8e0f-dd55fe1d9808 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:49.268178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ecadf-700d-40a4-8e0f-dd55fe1d9808 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:49.268293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ecadf-700d-40a4-8e0f-dd55fe1d9808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:49.296825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c58ecadf-700d-40a4-8e0f-dd55fe1d9808 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:49.298013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c58ecadf-700d-40a4-8e0f-dd55fe1d9808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:49.307238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:49.347736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0aa4c-6ad4-451c-90dd-328391fff23a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:49.359560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0aa4c-6ad4-451c-90dd-328391fff23a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:49.363938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cb711-b22d-4f9e-831c-bac7f99de264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:49.364559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb711-b22d-4f9e-831c-bac7f99de264 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:49.364826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb711-b22d-4f9e-831c-bac7f99de264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:49.365092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cb711-b22d-4f9e-831c-bac7f99de264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:49.374062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cb711-b22d-4f9e-831c-bac7f99de264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:49.375517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cb711-b22d-4f9e-831c-bac7f99de264 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:49.384661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 742/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:51.629078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032005f-3833-4212-b757-dddf074322c9 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:51.630115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032005f-3833-4212-b757-dddf074322c9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:51.630115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032005f-3833-4212-b757-dddf074322c9 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:51.632188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:51.637604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976936-6453-438d-a749-3020647c8e43 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:51.638048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976936-6453-438d-a749-3020647c8e43 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:51.638162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976936-6453-438d-a749-3020647c8e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:51.656114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-54976936-6453-438d-a749-3020647c8e43 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:51.657204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-54976936-6453-438d-a749-3020647c8e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:51.666198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:51.704527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032005f-3833-4212-b757-dddf074322c9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:51.721488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032005f-3833-4212-b757-dddf074322c9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:51.726084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae906ae0-ac0d-4d58-8db0-be408d5649c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:51.726709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906ae0-ac0d-4d58-8db0-be408d5649c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:51.727021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906ae0-ac0d-4d58-8db0-be408d5649c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:51.727294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906ae0-ac0d-4d58-8db0-be408d5649c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:51.737223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae906ae0-ac0d-4d58-8db0-be408d5649c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:51.738653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae906ae0-ac0d-4d58-8db0-be408d5649c7 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:51.748581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 721/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:53.982074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1242c0-5a8f-4fd2-921c-38183b9b0e40 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:53.982995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1242c0-5a8f-4fd2-921c-38183b9b0e40 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:53.982995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1242c0-5a8f-4fd2-921c-38183b9b0e40 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:53.985291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:53.991632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c49c-0a91-4b75-8b8a-679821566f35 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:53.992096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c49c-0a91-4b75-8b8a-679821566f35 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:53.992194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c49c-0a91-4b75-8b8a-679821566f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:54.011482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7c30c49c-0a91-4b75-8b8a-679821566f35 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:54.012658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7c30c49c-0a91-4b75-8b8a-679821566f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:54.020893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:54.058146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1242c0-5a8f-4fd2-921c-38183b9b0e40 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:54.072460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1242c0-5a8f-4fd2-921c-38183b9b0e40 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:54.077226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e104a7-b52f-479d-9168-3eeeb074f135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:54.077863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e104a7-b52f-479d-9168-3eeeb074f135 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:54.078127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e104a7-b52f-479d-9168-3eeeb074f135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:54.078404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e104a7-b52f-479d-9168-3eeeb074f135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:54.087525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e104a7-b52f-479d-9168-3eeeb074f135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:54.088976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e104a7-b52f-479d-9168-3eeeb074f135 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:54.098509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 745/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:09:56.304293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406f2e-8034-4711-91c7-e56bc5582381 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:56.305358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406f2e-8034-4711-91c7-e56bc5582381 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:56.305358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406f2e-8034-4711-91c7-e56bc5582381 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:56.307422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:09:56.315149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d218b35-fead-4fdd-8555-deb0eaf9a136 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:56.315555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d218b35-fead-4fdd-8555-deb0eaf9a136 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:56.315698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d218b35-fead-4fdd-8555-deb0eaf9a136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:56.333856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8d218b35-fead-4fdd-8555-deb0eaf9a136 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:09:56.335045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8d218b35-fead-4fdd-8555-deb0eaf9a136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:09:56.343382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:09:56.380092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406f2e-8034-4711-91c7-e56bc5582381 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:09:56.397322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406f2e-8034-4711-91c7-e56bc5582381 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:09:56.402781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54458589-42b0-49f1-84e8-b6ae001b29a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:09:56.403465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54458589-42b0-49f1-84e8-b6ae001b29a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:09:56.403743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54458589-42b0-49f1-84e8-b6ae001b29a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:09:56.404015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54458589-42b0-49f1-84e8-b6ae001b29a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:09:56.415084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54458589-42b0-49f1-84e8-b6ae001b29a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:09:56.416510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54458589-42b0-49f1-84e8-b6ae001b29a4 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:09:56.425953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 724/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:10:29.352360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54761-318e-4e72-8f40-ad2edfa592da None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:29.352991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54761-318e-4e72-8f40-ad2edfa592da None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:29.352991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54761-318e-4e72-8f40-ad2edfa592da None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:29.355387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 747/1471] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:29.364553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8893-6007-4f82-970a-a98477fa141e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:29.365321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8893-6007-4f82-970a-a98477fa141e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:29.365531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a8893-6007-4f82-970a-a98477fa141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:29.387307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1d9a8893-6007-4f82-970a-a98477fa141e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:29.389664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1d9a8893-6007-4f82-970a-a98477fa141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:29.396933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 725/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:29.450095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b93fa-db80-4330-9578-064e49062239 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:29.450404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b93fa-db80-4330-9578-064e49062239 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:29.450703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b93fa-db80-4330-9578-064e49062239 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:29.452197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 748/1473] 10.222.0.59 () {54 vars in 962 bytes} [Wed May 4 08:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:29.459595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a186e-2684-4ef7-bc74-81651b6f36bd None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:29.459881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a186e-2684-4ef7-bc74-81651b6f36bd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:29.460195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a186e-2684-4ef7-bc74-81651b6f36bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:29.481475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-479a186e-2684-4ef7-bc74-81651b6f36bd None None] MFA Rules not processed for user `5a8dcc7e7ecb48c7b89845bbd9babbeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:29.482650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-479a186e-2684-4ef7-bc74-81651b6f36bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:29.490259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 726/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Wed May 4 08:10:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:29.497758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b93fa-db80-4330-9578-064e49062239 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:29.509574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b93fa-db80-4330-9578-064e49062239 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:29.513642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24449a2c-119c-44f5-9803-7ebf86240b10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:29.514297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24449a2c-119c-44f5-9803-7ebf86240b10 service glance] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:29.514609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24449a2c-119c-44f5-9803-7ebf86240b10 service glance] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:29.515011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24449a2c-119c-44f5-9803-7ebf86240b10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:29.524559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24449a2c-119c-44f5-9803-7ebf86240b10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:29.525995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24449a2c-119c-44f5-9803-7ebf86240b10 service glance] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:29.535600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 749/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:10:31.868049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662beaf-6556-4357-a15a-e0dc514dcf10 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:31.868564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662beaf-6556-4357-a15a-e0dc514dcf10 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:31.868564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662beaf-6556-4357-a15a-e0dc514dcf10 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:31.869953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 727/1476] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:31.875420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c60ac-5e4d-42aa-90ab-dca355f9b589 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:31.875894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c60ac-5e4d-42aa-90ab-dca355f9b589 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:31.876000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c60ac-5e4d-42aa-90ab-dca355f9b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:31.894777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a15c60ac-5e4d-42aa-90ab-dca355f9b589 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:31.895987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a15c60ac-5e4d-42aa-90ab-dca355f9b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:31.904760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 750/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:31.928017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662beaf-6556-4357-a15a-e0dc514dcf10 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:31.942450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662beaf-6556-4357-a15a-e0dc514dcf10 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:31.947995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:31.948648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:31.948916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:31.949196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:31.949925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:31.951792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:10:31.951792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:10:31.951792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:10:31.952961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470d3d-b853-4675-aa67-e9366c9b89fe admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:31.972185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 728/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Wed May 4 08:10:31 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:10:34.213539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d74112-71d7-4c9f-b9b1-d7e05b7a4756 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:34.214064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d74112-71d7-4c9f-b9b1-d7e05b7a4756 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:34.214168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d74112-71d7-4c9f-b9b1-d7e05b7a4756 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:34.216109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 751/1479] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:34.222038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44ca4-3592-4e0f-b25f-62fa8ec39714 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:34.222491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44ca4-3592-4e0f-b25f-62fa8ec39714 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:34.222603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44ca4-3592-4e0f-b25f-62fa8ec39714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:34.241219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a2e44ca4-3592-4e0f-b25f-62fa8ec39714 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:34.242391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2e44ca4-3592-4e0f-b25f-62fa8ec39714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:34.250414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 729/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:34.292509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d74112-71d7-4c9f-b9b1-d7e05b7a4756 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:34.308458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d74112-71d7-4c9f-b9b1-d7e05b7a4756 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:34.314755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ca7b3-6a2a-42d9-a82e-3eb0de66b87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:34.315407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca7b3-6a2a-42d9-a82e-3eb0de66b87e service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:34.315683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca7b3-6a2a-42d9-a82e-3eb0de66b87e service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:34.315950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ca7b3-6a2a-42d9-a82e-3eb0de66b87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:34.324401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca7b3-6a2a-42d9-a82e-3eb0de66b87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:34.326109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ca7b3-6a2a-42d9-a82e-3eb0de66b87e service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:34.335589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 752/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:10:36.728500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455973a6-9e32-4903-80eb-265a2b17675e None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:36.729329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455973a6-9e32-4903-80eb-265a2b17675e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:36.729329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455973a6-9e32-4903-80eb-265a2b17675e None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:36.731466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 730/1482] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:36.737644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae30a-8c45-4e74-b631-d9f2a52e9806 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:36.738079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae30a-8c45-4e74-b631-d9f2a52e9806 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:36.738194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae30a-8c45-4e74-b631-d9f2a52e9806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:36.760261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c6cae30a-8c45-4e74-b631-d9f2a52e9806 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:36.761437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c6cae30a-8c45-4e74-b631-d9f2a52e9806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:36.770202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 753/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:36.805971 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455973a6-9e32-4903-80eb-265a2b17675e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:36.819467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455973a6-9e32-4903-80eb-265a2b17675e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:36.823432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6711db-ebe1-46f3-807b-0e1acfb01ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:36.824091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6711db-ebe1-46f3-807b-0e1acfb01ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:36.824371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6711db-ebe1-46f3-807b-0e1acfb01ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:36.824643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6711db-ebe1-46f3-807b-0e1acfb01ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:36.834098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6711db-ebe1-46f3-807b-0e1acfb01ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:36.835557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6711db-ebe1-46f3-807b-0e1acfb01ad8 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:36.845076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 731/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:10:39.147822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4599-5c98-4396-833b-3047154d633f None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:39.148487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4599-5c98-4396-833b-3047154d633f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:39.148487 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d4599-5c98-4396-833b-3047154d633f None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:39.149737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 754/1485] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:39.155845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ad79-10db-4c62-af4f-6b5ef91e64c8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:39.156294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ad79-10db-4c62-af4f-6b5ef91e64c8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:39.156414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344ad79-10db-4c62-af4f-6b5ef91e64c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:39.185416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c344ad79-10db-4c62-af4f-6b5ef91e64c8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:39.186989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c344ad79-10db-4c62-af4f-6b5ef91e64c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:39.196444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 732/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:39.240436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4599-5c98-4396-833b-3047154d633f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:39.252300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d4599-5c98-4396-833b-3047154d633f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:39.256200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80268a14-b11e-4a22-99f0-4b8aaa00f464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:39.256838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268a14-b11e-4a22-99f0-4b8aaa00f464 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:39.257117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268a14-b11e-4a22-99f0-4b8aaa00f464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:39.257390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80268a14-b11e-4a22-99f0-4b8aaa00f464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:39.266570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268a14-b11e-4a22-99f0-4b8aaa00f464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:39.268036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80268a14-b11e-4a22-99f0-4b8aaa00f464 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:39.277354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 755/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:10:41.653030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24157262-0bb7-4f85-ad2e-72619f352b86 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:41.653619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24157262-0bb7-4f85-ad2e-72619f352b86 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:41.653619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24157262-0bb7-4f85-ad2e-72619f352b86 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:41.654999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 733/1488] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:41.661467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dffea-9c50-45d3-a0dd-3cf47886ff55 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:41.662114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dffea-9c50-45d3-a0dd-3cf47886ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:41.662296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dffea-9c50-45d3-a0dd-3cf47886ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:41.683663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2a7dffea-9c50-45d3-a0dd-3cf47886ff55 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:41.684866 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2a7dffea-9c50-45d3-a0dd-3cf47886ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:41.693850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 756/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:41.733633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24157262-0bb7-4f85-ad2e-72619f352b86 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:41.745269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24157262-0bb7-4f85-ad2e-72619f352b86 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:41.749253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52c7f-3a05-4dbe-bdb8-2e77aa43a8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:41.749877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52c7f-3a05-4dbe-bdb8-2e77aa43a8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:41.750156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52c7f-3a05-4dbe-bdb8-2e77aa43a8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:41.750420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52c7f-3a05-4dbe-bdb8-2e77aa43a8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:41.760374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52c7f-3a05-4dbe-bdb8-2e77aa43a8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:41.762626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52c7f-3a05-4dbe-bdb8-2e77aa43a8f2 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:41.772613 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 734/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:10:44.168021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dcdbf-a459-4423-b0a0-26c87a555958 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:44.168898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dcdbf-a459-4423-b0a0-26c87a555958 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:44.168898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dcdbf-a459-4423-b0a0-26c87a555958 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:44.171148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 757/1491] 10.222.0.59 () {54 vars in 926 bytes} [Wed May 4 08:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:10:44.176491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbecf1a-2364-4878-a818-d41f0c24893a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:44.176952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbecf1a-2364-4878-a818-d41f0c24893a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:44.177059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbecf1a-2364-4878-a818-d41f0c24893a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:44.195923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9bbecf1a-2364-4878-a818-d41f0c24893a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:10:44.197084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9bbecf1a-2364-4878-a818-d41f0c24893a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:10:44.205274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 735/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Wed May 4 08:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:10:44.245639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dcdbf-a459-4423-b0a0-26c87a555958 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:10:44.256986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dcdbf-a459-4423-b0a0-26c87a555958 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:10:44.260710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08a0ab-3281-4e4d-b424-aac2cb36fa5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:10:44.261328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a0ab-3281-4e4d-b424-aac2cb36fa5c service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:10:44.261601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a0ab-3281-4e4d-b424-aac2cb36fa5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:10:44.261869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08a0ab-3281-4e4d-b424-aac2cb36fa5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:10:44.270630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08a0ab-3281-4e4d-b424-aac2cb36fa5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:10:44.272097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08a0ab-3281-4e4d-b424-aac2cb36fa5c service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:10:44.281152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 758/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:12:11.498069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.498974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.498974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.523133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:12:11.524346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:12:11.533448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 736/1494] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:12:11.541529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.542034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.542135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.561603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:12:11.562773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:12:11.573263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 759/1495] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:12:11.577912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:11.588976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a5b7-d88c-48c2-a0c7-6d556273306f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:11.594679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:11.595343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.595646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.595911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.596630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:12:11.596931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:11.597962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:11.597962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:12:11.597962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:12:11.598839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:11.610530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 737/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:12:11.618744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:11.628265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a8d7-bea9-48ba-9880-8718fce1d984 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:11.634156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:11.634836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.635144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.635414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.636097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:11.637872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:11.637872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:12:11.637872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:12:11.639183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:11.680466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 760/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:12:11 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:12:11.684727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:11.694845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a841-692f-40ce-b298-4a6d72ad4912 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:11.749851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:11.750520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.750822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.751128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.751803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:11.752811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:11.752811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:12:11.752811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:12:11.754030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:11.774940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 738/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:12:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:12:11.779453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:11.790119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05400-5f1b-4be3-888c-91bacdbb61ea admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:11.795809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:11.796462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.796739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.797010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.797736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:11.798859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:11.798859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:12:11.798859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:12:11.799764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:11.813155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 761/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:12:11.817445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:11.828326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093349d-72cb-4191-b1f6-1b1f8c72bad2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:11.833914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:11.834573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.834856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.835155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.835883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:11.836888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:11.836888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:12:11.836888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:12:11.837810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc0c6-f6e7-4315-8dcc-d6afae9908bf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:11.851573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 739/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:12:11.855675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:11.865478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f806270-3861-4823-9640-53eb71ea6705 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:11.870234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:11.871149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.871431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.871704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] PATH_INFO: `/v3/projects/39b0fd28361d4f9d963bd9a269ecb482/users/1176cce91b2145dda9568782779b0529/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.887040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b0fd28361d4f9d963bd9a269ecb482, user_id=1176cce91b2145dda9568782779b0529, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:11.888080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:11.888080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:12:11.888080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:12:11.889993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:11.905700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 762/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:12:11 2022] PUT /identity/v3/projects/39b0fd28361d4f9d963bd9a269ecb482/users/1176cce91b2145dda9568782779b0529/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:12:11.917534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411364d-1f6d-4f11-904f-bca4a6c10a49 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:11.917849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411364d-1f6d-4f11-904f-bca4a6c10a49 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:11.918118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411364d-1f6d-4f11-904f-bca4a6c10a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:11.945337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d411364d-1f6d-4f11-904f-bca4a6c10a49 None None] MFA Rules not processed for user `1176cce91b2145dda9568782779b0529`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:12:11.946482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d411364d-1f6d-4f11-904f-bca4a6c10a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:12:12.021755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 740/1502] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:12:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:12:12.033254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:12.103770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625ce62-74b0-4ad0-872d-643f7ba8d649 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:12.109461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:12.110091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:12.110365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:12.110627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:12.118831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:12.121553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:12.136034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 763/1503] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:12:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:12:12.215086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f246a67-67b8-4f58-97be-ceb6de7c94d8 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:12.215453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f246a67-67b8-4f58-97be-ceb6de7c94d8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:12.215741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f246a67-67b8-4f58-97be-ceb6de7c94d8 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:12.217551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 741/1504] 10.222.0.59 () {52 vars in 829 bytes} [Wed May 4 08:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:12:12.222819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:12.290744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0875-3659-44c3-bf4d-1f975f07816e service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:12.296398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:12.297269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:12.297543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:12.297817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] PATH_INFO: `/v3/users/1176cce91b2145dda9568782779b0529` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:12.299087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1176cce91b2145dda9568782779b0529)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:12.300110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:12.300110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:12:12.300110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:12:12.301308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:12.380115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1176cce91b2145dda9568782779b0529'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:12.390913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1176cce91b2145dda9568782779b0529'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:12.403902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1176cce91b2145dda9568782779b0529'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:12.405941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1176cce91b2145dda9568782779b0529'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:12.406779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1176cce91b2145dda9568782779b0529'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:12.432915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 764/1505] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:12:12 2022] DELETE /identity/v3/users/1176cce91b2145dda9568782779b0529 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:12:12.437885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:12.438172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:12.438444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:12.456657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:12:12.457817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:12:12.517226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 742/1506] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:12:12.527160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:12.528647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:12:12.599086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc1c7-5f03-4a44-8358-65ad44db0984 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:12.604046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267f237-5827-4454-a79a-a18f210cc0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:12.604690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f237-5827-4454-a79a-a18f210cc0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:12.604961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f237-5827-4454-a79a-a18f210cc0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:12.605224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f237-5827-4454-a79a-a18f210cc0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:12.615758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f237-5827-4454-a79a-a18f210cc0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:12.617197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267f237-5827-4454-a79a-a18f210cc0f7 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:12.626913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 765/1507] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:12:13.012382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:12:13.013979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:12:13.026236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341eb097-74cd-4550-b918-c7aa8983e74b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:12:13.031560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:12:13.032862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:12:13.033197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:12:13.033590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] PATH_INFO: `/v3/projects/39b0fd28361d4f9d963bd9a269ecb482` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:12:13.034935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b0fd28361d4f9d963bd9a269ecb482)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:12:13.036041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:12:13.036041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:12:13.036041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:12:13.037238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:12:13.102436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b0fd28361d4f9d963bd9a269ecb482', 'request_id': 'req-4edeba70-13d5-4449-bfa1-03c10fa16f0c'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:13.115710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b0fd28361d4f9d963bd9a269ecb482', 'request_id': 'req-4edeba70-13d5-4449-bfa1-03c10fa16f0c'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:13.125987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b0fd28361d4f9d963bd9a269ecb482', 'request_id': 'req-4edeba70-13d5-4449-bfa1-03c10fa16f0c'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:13.137286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] The token cache is being invalidate because project 39b0fd28361d4f9d963bd9a269ecb482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:12:13.137572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:13.138272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4edeba70-13d5-4449-bfa1-03c10fa16f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:12:13.140041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 743/1508] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:12:13 2022] DELETE /identity/v3/projects/39b0fd28361d4f9d963bd9a269ecb482 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:13:56.668765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16048df9-25d0-444e-a979-0d51d0772fae None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:56.669335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16048df9-25d0-444e-a979-0d51d0772fae None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:56.669335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16048df9-25d0-444e-a979-0d51d0772fae None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:56.670625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 766/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:13:56.675851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6203af-9d5e-484c-9670-f5982493fd32 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:56.676310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6203af-9d5e-484c-9670-f5982493fd32 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:56.676422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6203af-9d5e-484c-9670-f5982493fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:56.695198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-bc6203af-9d5e-484c-9670-f5982493fd32 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:13:56.696433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bc6203af-9d5e-484c-9670-f5982493fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:13:56.757876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 744/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:13:56.916541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16048df9-25d0-444e-a979-0d51d0772fae None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:13:56.918423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-16048df9-25d0-444e-a979-0d51d0772fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:13:56.998982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16048df9-25d0-444e-a979-0d51d0772fae None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:13:57.005399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24f7a2-df8c-4b88-aaa3-a22a1d176a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:13:57.006036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24f7a2-df8c-4b88-aaa3-a22a1d176a7f service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:57.006316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24f7a2-df8c-4b88-aaa3-a22a1d176a7f service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:57.006589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24f7a2-df8c-4b88-aaa3-a22a1d176a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:57.015414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24f7a2-df8c-4b88-aaa3-a22a1d176a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:13:57.017066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24f7a2-df8c-4b88-aaa3-a22a1d176a7f service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:13:57.026496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 767/1511] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:13:57.442057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089f18-983f-4264-aef3-aa3eef3217d0 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:57.442437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089f18-983f-4264-aef3-aa3eef3217d0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:57.442804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089f18-983f-4264-aef3-aa3eef3217d0 None None] PATH_INFO: `/v3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:57.444219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 745/1512] 10.222.0.13 () {54 vars in 925 bytes} [Wed May 4 08:13:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:13:57.451358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347b9b8-e78d-4e07-b429-e4295a62d054 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:57.451779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347b9b8-e78d-4e07-b429-e4295a62d054 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:57.452057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347b9b8-e78d-4e07-b429-e4295a62d054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:57.471603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8347b9b8-e78d-4e07-b429-e4295a62d054 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:13:57.472941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8347b9b8-e78d-4e07-b429-e4295a62d054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:13:57.536858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 768/1513] 10.222.0.13 () {58 vars in 1015 bytes} [Wed May 4 08:13:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:13:58.246516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac954b38-0f09-4a38-9520-ef9e4d0e7e6e None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:58.247483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac954b38-0f09-4a38-9520-ef9e4d0e7e6e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:58.247483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac954b38-0f09-4a38-9520-ef9e4d0e7e6e None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:58.249647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 746/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:13:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:13:58.256970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3192b-fa35-40be-83dd-2509e8bd4124 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:58.257401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3192b-fa35-40be-83dd-2509e8bd4124 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:58.257513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3192b-fa35-40be-83dd-2509e8bd4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:58.279449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3ff3192b-fa35-40be-83dd-2509e8bd4124 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:13:58.280631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3ff3192b-fa35-40be-83dd-2509e8bd4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:13:58.289973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 769/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:13:58.443502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac954b38-0f09-4a38-9520-ef9e4d0e7e6e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:13:58.460573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac954b38-0f09-4a38-9520-ef9e4d0e7e6e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:13:58.466686 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e5752-e1c3-4b65-8421-717c9293dc7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:13:58.467361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5752-e1c3-4b65-8421-717c9293dc7c service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:13:58.467637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5752-e1c3-4b65-8421-717c9293dc7c service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:13:58.468021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e5752-e1c3-4b65-8421-717c9293dc7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:13:58.476280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5752-e1c3-4b65-8421-717c9293dc7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:13:58.477964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e5752-e1c3-4b65-8421-717c9293dc7c service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:13:58.487298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 747/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:06.533918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29dc8d-13f8-4993-9d45-f9f1a043abe8 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:06.534472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29dc8d-13f8-4993-9d45-f9f1a043abe8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:06.534472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29dc8d-13f8-4993-9d45-f9f1a043abe8 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:06.535784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 770/1517] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 4 08:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:06.542963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8e46-3d71-44cf-9842-a93c07e4dc37 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:06.542963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8e46-3d71-44cf-9842-a93c07e4dc37 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:06.542963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8e46-3d71-44cf-9842-a93c07e4dc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:06.567696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-148c8e46-3d71-44cf-9842-a93c07e4dc37 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:06.568914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-148c8e46-3d71-44cf-9842-a93c07e4dc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:06.580060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 748/1518] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 4 08:14:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:06.588078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29dc8d-13f8-4993-9d45-f9f1a043abe8 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:06.610610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29dc8d-13f8-4993-9d45-f9f1a043abe8 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:06.618915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f248967-bfee-402b-a113-8cc89de4c5ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b99e7835d04098ad38e4eee401ea91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:06.619556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248967-bfee-402b-a113-8cc89de4c5ca service placement] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:06.619833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248967-bfee-402b-a113-8cc89de4c5ca service placement] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:06.620099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f248967-bfee-402b-a113-8cc89de4c5ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:06.629613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f248967-bfee-402b-a113-8cc89de4c5ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:06.631709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f248967-bfee-402b-a113-8cc89de4c5ca service placement] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:06.642372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 771/1519] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:10.127779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d8f1-0593-4bff-be8f-cf1b7e165c78 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:10.128388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d8f1-0593-4bff-be8f-cf1b7e165c78 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:10.128388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d8f1-0593-4bff-be8f-cf1b7e165c78 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:10.129677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 749/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:10.135613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4b5c0-b218-42d0-a756-d6852d92ecd3 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:10.136323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4b5c0-b218-42d0-a756-d6852d92ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:10.136463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4b5c0-b218-42d0-a756-d6852d92ecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:10.160746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fab4b5c0-b218-42d0-a756-d6852d92ecd3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:10.161936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fab4b5c0-b218-42d0-a756-d6852d92ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:10.171389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 772/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:10.324281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d8f1-0593-4bff-be8f-cf1b7e165c78 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:10.345526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6d8f1-0593-4bff-be8f-cf1b7e165c78 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:10.352025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a4277-308a-4cbf-8749-cabcf6aa9f6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:10.352658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4277-308a-4cbf-8749-cabcf6aa9f6e service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:10.352952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4277-308a-4cbf-8749-cabcf6aa9f6e service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:10.353227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a4277-308a-4cbf-8749-cabcf6aa9f6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:10.361524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4277-308a-4cbf-8749-cabcf6aa9f6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:10.363141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a4277-308a-4cbf-8749-cabcf6aa9f6e service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:10.373586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 750/1522] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:11.581253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6200-eb2d-4667-9aa1-a3748981700d None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:11.582105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6200-eb2d-4667-9aa1-a3748981700d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:11.582105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6200-eb2d-4667-9aa1-a3748981700d None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:11.584473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 773/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 08:14:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:11.590902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3016-6bbe-4e9c-94d1-452e3feb9513 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:11.591307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3016-6bbe-4e9c-94d1-452e3feb9513 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:11.591467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3016-6bbe-4e9c-94d1-452e3feb9513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:11.610906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7aaf3016-6bbe-4e9c-94d1-452e3feb9513 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:11.612116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7aaf3016-6bbe-4e9c-94d1-452e3feb9513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:11.620730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 751/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 08:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:11.790642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6200-eb2d-4667-9aa1-a3748981700d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:11.807581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6200-eb2d-4667-9aa1-a3748981700d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:11.815623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a99a4-4c1c-4034-be50-e94cdfe0bdad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:11.816255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a99a4-4c1c-4034-be50-e94cdfe0bdad service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:11.816527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a99a4-4c1c-4034-be50-e94cdfe0bdad service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:11.816798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a99a4-4c1c-4034-be50-e94cdfe0bdad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:11.825594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a99a4-4c1c-4034-be50-e94cdfe0bdad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:11.827382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a99a4-4c1c-4034-be50-e94cdfe0bdad service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:11.836672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 774/1525] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:16.309766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d6862-ee2c-4e8c-81b2-13bf16429562 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:16.310347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d6862-ee2c-4e8c-81b2-13bf16429562 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:16.310347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d6862-ee2c-4e8c-81b2-13bf16429562 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:16.312284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 752/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:14:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:16.320966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb63aa-07dd-4600-a759-15734e338c87 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:16.321421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb63aa-07dd-4600-a759-15734e338c87 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:16.321526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb63aa-07dd-4600-a759-15734e338c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:16.344920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d8eb63aa-07dd-4600-a759-15734e338c87 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:16.346065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d8eb63aa-07dd-4600-a759-15734e338c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:16.354449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 775/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:16.392223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d6862-ee2c-4e8c-81b2-13bf16429562 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:16.394057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-db6d6862-ee2c-4e8c-81b2-13bf16429562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:16.455503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d6862-ee2c-4e8c-81b2-13bf16429562 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:16.459788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194397-3d76-429f-bc29-65633def3cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:16.460425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194397-3d76-429f-bc29-65633def3cca service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:16.460701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194397-3d76-429f-bc29-65633def3cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:16.460970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194397-3d76-429f-bc29-65633def3cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:16.470670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194397-3d76-429f-bc29-65633def3cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:16.472126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194397-3d76-429f-bc29-65633def3cca service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:16.481703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 753/1528] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:18.686317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0235b-ab1d-4a60-a34d-0c7144db9dfb None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:18.687195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0235b-ab1d-4a60-a34d-0c7144db9dfb None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:18.687195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0235b-ab1d-4a60-a34d-0c7144db9dfb None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:18.689231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 776/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:14:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:18.695619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f556d-cf9b-4312-bada-6ac30173fd5a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:18.696083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f556d-cf9b-4312-bada-6ac30173fd5a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:18.696192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f556d-cf9b-4312-bada-6ac30173fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:18.715653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-431f556d-cf9b-4312-bada-6ac30173fd5a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:18.716863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-431f556d-cf9b-4312-bada-6ac30173fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:18.726370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 754/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:18.762908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0235b-ab1d-4a60-a34d-0c7144db9dfb None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:18.775239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0235b-ab1d-4a60-a34d-0c7144db9dfb None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:18.780219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695bde9-eafb-462f-990e-db657a300487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:18.780849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695bde9-eafb-462f-990e-db657a300487 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:18.781123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695bde9-eafb-462f-990e-db657a300487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:18.781389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695bde9-eafb-462f-990e-db657a300487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:18.791694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695bde9-eafb-462f-990e-db657a300487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:18.793133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695bde9-eafb-462f-990e-db657a300487 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:18.802824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 777/1531] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:23.043689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade80a4-b903-4633-ad10-fdd742c0dd9b None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:23.044594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade80a4-b903-4633-ad10-fdd742c0dd9b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:23.044594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade80a4-b903-4633-ad10-fdd742c0dd9b None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:23.046763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 755/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:14:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:23.052148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807cca-7f3c-4b25-bfaf-266f4760194c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:23.052580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807cca-7f3c-4b25-bfaf-266f4760194c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:23.052675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa807cca-7f3c-4b25-bfaf-266f4760194c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:23.071773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-aa807cca-7f3c-4b25-bfaf-266f4760194c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:23.072947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-aa807cca-7f3c-4b25-bfaf-266f4760194c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:23.081996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 778/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:23.357695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade80a4-b903-4633-ad10-fdd742c0dd9b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:23.359764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3ade80a4-b903-4633-ad10-fdd742c0dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:23.433562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade80a4-b903-4633-ad10-fdd742c0dd9b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:23.437828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291602f-8d17-4d7b-b18a-2058d7558ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:23.438843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291602f-8d17-4d7b-b18a-2058d7558ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:23.439173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291602f-8d17-4d7b-b18a-2058d7558ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:23.439446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291602f-8d17-4d7b-b18a-2058d7558ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:23.448611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291602f-8d17-4d7b-b18a-2058d7558ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:23.450072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291602f-8d17-4d7b-b18a-2058d7558ae0 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:23.459793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 756/1534] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:14:25.759991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28357-4ffe-409c-b372-ff7695083da8 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:25.760556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28357-4ffe-409c-b372-ff7695083da8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:25.760556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28357-4ffe-409c-b372-ff7695083da8 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:25.761836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 779/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 08:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:25.768285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857add0-ca11-4431-8df4-76f94cb1ccdc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:25.768956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857add0-ca11-4431-8df4-76f94cb1ccdc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:25.769065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857add0-ca11-4431-8df4-76f94cb1ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:25.790533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8857add0-ca11-4431-8df4-76f94cb1ccdc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:25.791803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8857add0-ca11-4431-8df4-76f94cb1ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:25.801298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 757/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 08:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:26.074037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fdf54-9061-4949-9349-dbfe80455f55 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:26.074332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fdf54-9061-4949-9349-dbfe80455f55 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:26.074602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fdf54-9061-4949-9349-dbfe80455f55 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:26.076025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 780/1537] 10.222.0.59 () {54 vars in 963 bytes} [Wed May 4 08:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:14:26.084238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad407e-1b9d-4726-b8df-95aa93d8066a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:26.084708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad407e-1b9d-4726-b8df-95aa93d8066a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:26.085166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad407e-1b9d-4726-b8df-95aa93d8066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:26.114252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-68ad407e-1b9d-4726-b8df-95aa93d8066a None None] MFA Rules not processed for user `df742434fdab408581ad24749c6c9331`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:14:26.116146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-68ad407e-1b9d-4726-b8df-95aa93d8066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:14:26.124691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 758/1538] 10.222.0.59 () {58 vars in 1060 bytes} [Wed May 4 08:14:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:14:26.132502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fdf54-9061-4949-9349-dbfe80455f55 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:14:26.144993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fdf54-9061-4949-9349-dbfe80455f55 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:14:26.149116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf56a-1ca3-4706-9df3-6c47aa0c8f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:14:26.149757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf56a-1ca3-4706-9df3-6c47aa0c8f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:14:26.150039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf56a-1ca3-4706-9df3-6c47aa0c8f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:14:26.150310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf56a-1ca3-4706-9df3-6c47aa0c8f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:14:26.159764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf56a-1ca3-4706-9df3-6c47aa0c8f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:14:26.161206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf56a-1ca3-4706-9df3-6c47aa0c8f15 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:14:26.170641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 781/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:55.338081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b7862-850d-46a8-803b-64805c85374a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.338867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b7862-850d-46a8-803b-64805c85374a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.338867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b7862-850d-46a8-803b-64805c85374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.376970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0be1-dc95-4df8-b40a-4f96fa93ec07 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.377609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0be1-dc95-4df8-b40a-4f96fa93ec07 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.377609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0be1-dc95-4df8-b40a-4f96fa93ec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.385899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-857b7862-850d-46a8-803b-64805c85374a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.385899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-857b7862-850d-46a8-803b-64805c85374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.405133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 759/1540] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.405778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f4dd0be1-dc95-4df8-b40a-4f96fa93ec07 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.407304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f4dd0be1-dc95-4df8-b40a-4f96fa93ec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.416013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729b22b-084f-4e95-a8c9-717601b3facc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.416299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729b22b-084f-4e95-a8c9-717601b3facc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.416763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729b22b-084f-4e95-a8c9-717601b3facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.425877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 782/1541] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:15:55.437141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.437882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.438326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.446161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1729b22b-084f-4e95-a8c9-717601b3facc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.447433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1729b22b-084f-4e95-a8c9-717601b3facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.461766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 760/1542] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.464345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.464960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.465406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.475303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.477119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.500274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.501648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.503782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 783/1543] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:15:55.504817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.510287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 761/1544] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 04 08:15:55.515145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.528314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c22c3-d2c2-4552-86a8-e4e7cfd4e7e5 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.529396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4b1f9-24e1-4501-b96f-d4accba854e0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.540014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.541085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.541559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.542098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.543057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:55.543649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.545519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c25ac5-c8ab-430c-8609-1c77cf84fcf9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.552477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.553611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.554061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.554486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.555412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:55.555887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.557431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 08:15:55.557431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:15:55.557431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:15:55.558803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.567098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 762/1545] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:15:55.568634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d871a3-c2fe-4bd3-9beb-018d95ba7fcd None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.569778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d871a3-c2fe-4bd3-9beb-018d95ba7fcd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.575427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d871a3-c2fe-4bd3-9beb-018d95ba7fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.592259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 784/1546] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:55.593475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.600323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f9d871a3-c2fe-4bd3-9beb-018d95ba7fcd None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.601744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f9d871a3-c2fe-4bd3-9beb-018d95ba7fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.610354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06060-236a-407e-8c4f-083e466e0707 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.617123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 763/1547] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.618820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cb393-58da-4931-a5ad-df10883a925d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.619295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cb393-58da-4931-a5ad-df10883a925d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.619819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cb393-58da-4931-a5ad-df10883a925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.625194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.626044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.626429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.626805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.627629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.629657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.641527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-842cb393-58da-4931-a5ad-df10883a925d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.643039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-842cb393-58da-4931-a5ad-df10883a925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.659099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 764/1548] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.660868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.661321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.661748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.675852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 785/1549] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:55.676722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.690766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.692296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.746339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0b48-8730-4a4d-a8c7-0aeceb0741ad admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.750410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 765/1550] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.751715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.755349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.756219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.756342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.756592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.757388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:55.757699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.759657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78070a-2f3e-4172-9ddf-7953c1474a7b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.761835 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047782ef-fd99-4b16-8b40-d8f8e0f1c932 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.766678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.767377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.767658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.767935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.768649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.769687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:15:55.769687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:15:55.769687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:15:55.770908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a714b0e-9ad6-40e3-b219-6d56e58c51b9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.772129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 786/1551] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:55.773435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.773723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.774001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.795601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.796802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.801607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 766/1552] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:55.801607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722aeac-1424-4fbc-a54e-6fcf955556b1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.801607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722aeac-1424-4fbc-a54e-6fcf955556b1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.801607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722aeac-1424-4fbc-a54e-6fcf955556b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.819482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-4722aeac-1424-4fbc-a54e-6fcf955556b1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.820683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4722aeac-1424-4fbc-a54e-6fcf955556b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.857691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 787/1553] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.858581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.868919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b6699-eeea-4327-b54c-a8e46660f8f1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.873777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.874461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.874737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.875040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.875736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.876758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:15:55.876758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:15:55.876758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:15:55.877976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0f8cc-2825-4ba4-8467-28a4572d0820 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.878865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 767/1554] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.880265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118620-2eab-4131-9082-c431aaa934ea None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.880557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118620-2eab-4131-9082-c431aaa934ea None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.880825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e118620-2eab-4131-9082-c431aaa934ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.902042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 788/1555] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:55.902042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.902042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.902042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.902541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8e118620-2eab-4131-9082-c431aaa934ea None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.902541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8e118620-2eab-4131-9082-c431aaa934ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.910429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 768/1556] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.919103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.919103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.919103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.920843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.922024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.930025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 789/1557] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.930809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.932287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:55.933701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:55.940679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245206b5-6b0d-42e6-8277-9cf21a85d4c1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.946527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 769/1558] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:55.946527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.948493 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293815-70ed-4090-a0c7-74026700bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.950733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293815-70ed-4090-a0c7-74026700bf0a admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.950733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293815-70ed-4090-a0c7-74026700bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.950733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293815-70ed-4090-a0c7-74026700bf0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.950733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b293815-70ed-4090-a0c7-74026700bf0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.952423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b293815-70ed-4090-a0c7-74026700bf0a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.956354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbc265-f7e0-4cbb-9f15-a5def18699f1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:55.960917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:55.961578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.961860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.962132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.962842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:55.964863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:55.980035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 790/1559] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:55.981455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:55.981741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:55.982012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:55.989339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 770/1560] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:55.989339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:55.997369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a479-23b4-484e-804e-9082620bba54 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.000557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:56.002098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:56.050773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.051475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.051746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.052016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.052834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:56.053050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.054699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66db6d-594b-4e3d-af6b-0fa93db5d773 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.060560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 791/1561] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:56.061467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.066959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 771/1562] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:56.068221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.068509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.068780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.071356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acecd9-bc19-46e3-912e-c63db80d55f1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.076314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241bd76-9217-4fc2-821d-efc7e5d1669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.077001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bd76-9217-4fc2-821d-efc7e5d1669b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.077283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bd76-9217-4fc2-821d-efc7e5d1669b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.077550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bd76-9217-4fc2-821d-efc7e5d1669b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.078293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241bd76-9217-4fc2-821d-efc7e5d1669b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.079998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241bd76-9217-4fc2-821d-efc7e5d1669b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.087562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:56.088774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:56.090398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 792/1563] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.091794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.092085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.092363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.097318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 772/1564] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:56.098127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.108365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ac02-bbfa-4c35-84ff-ef4a8beb9fc2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.110508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:56.111742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:56.112810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.113461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.113732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.114064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.114745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:56.115074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.116688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.121031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 793/1565] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:56.121785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.128792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 773/1566] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:56.129668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.131466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83730f78-dbe3-4315-ab79-076e6d62f7b9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.136855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.137522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.137805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.138076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.138769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.139341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6e66-1fa7-475e-809e-6f3033b5496a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.140813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.143854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.144513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.144797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.145064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.145776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.147501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.161767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 774/1567] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.161767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.164652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 794/1568] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.168401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.171894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f6d01-82ab-439f-9d1d-9b99b821875d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.176575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.177228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.177511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.177814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.177967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639524-917b-49b6-848d-3c79761e959a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.178565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:56.178865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.180480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.183244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.183895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.184166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.184430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.185084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.187098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.192530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 775/1569] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:56.193286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.209293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca0ea-75ef-4cb3-85b8-5603fb9a7fd4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.214948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 795/1570] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.214948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.217368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.218028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.218302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.218600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.219376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.220957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.230696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 776/1571] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.231509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.242836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d5cc-ca7c-42e3-9a2d-5e51b6994d2b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.274241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b94a77-52c8-4b0e-8e3b-8be45739fd73 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.279038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.279700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.279976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.280247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.280979 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:56.281285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.282912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.294364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 796/1572] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:56.295383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.298449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.299151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.299429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.299701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.300425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:15:56.300727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.303573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.305489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4cc79-023b-40bc-bc50-7c4b4169c7dc admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.310782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.311478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.311741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.312005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.312682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.314608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.317342 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 777/1573] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:15:56.318204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.328612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033127e3-2edb-44c7-9ca9-0a91c02c5821 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.333531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.334196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.334473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.334745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.335502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.337136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.342701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 797/1574] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.343410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.348642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 778/1575] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.350077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.359927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38ec10-d1b5-4e19-ae1c-3d7f68f9f8c0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.409265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246f103-302f-40d9-b132-1704a2f23c38 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.414823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.415543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.415818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.416099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.416814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.418438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.419116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.419879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.420296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.420574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.421293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.423208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.429519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 798/1576] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.429660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.439105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f76f4-dd4a-4e55-b3da-31ef67498824 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.443947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.444606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.444908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.445382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.445848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.447871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.454930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 779/1577] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.454930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.467862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 799/1578] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/users => generated 303 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.468499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.477438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23891459-2a38-45ee-8925-fedff2b7dbcd admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.513895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec380-60f7-4af9-bbc9-75df4450c6bf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.519412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.520313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.520589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.520858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] PATH_INFO: `/v3/projects/627a6ec20d314e7ba545b36a7e9b2fe8/users/51cf5070eaa549cfa05bcf76848b545b/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.531275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.531951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.532223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.532460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.533169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.535092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.536522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=627a6ec20d314e7ba545b36a7e9b2fe8, user_id=51cf5070eaa549cfa05bcf76848b545b, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.537551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:15:56.537551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:15:56.537551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:15:56.539568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.553242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 780/1579] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:56 2022] PUT /identity/v3/projects/627a6ec20d314e7ba545b36a7e9b2fe8/users/51cf5070eaa549cfa05bcf76848b545b/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:56.554184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.561827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 800/1580] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.564499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.615612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b937e37-9228-46a2-ae0f-68cf161f8d2c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.630058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef25a3f-3bd7-40fd-bd05-8057254f1b3d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.634923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.635631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.635911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.636185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.636863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.638783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.661504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 801/1581] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.661504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.668674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ddfb-1c9c-40b2-a66c-3bac49eb364f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.669569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.670238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.670518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.670788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.671499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.673314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.673444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.674175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.674522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.674731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] PATH_INFO: `/v3/projects/49d87bce57a4470d85b4df9b85eb9602/users/090f701bb7e54a72ab9a5c84fba01fc2/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.691405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d87bce57a4470d85b4df9b85eb9602, user_id=090f701bb7e54a72ab9a5c84fba01fc2, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.694404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.702426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 781/1582] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.703451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.708587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 802/1583] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:56 2022] PUT /identity/v3/projects/49d87bce57a4470d85b4df9b85eb9602/users/090f701bb7e54a72ab9a5c84fba01fc2/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:56.709427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.763557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2bfe8-3388-4cfa-a3ab-4f49aa1f06d0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.768335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.768995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.769269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.769534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.770250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.771786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47918af-f6af-4465-bace-9ceffcca62b8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.771907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.776310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235cbe71-7685-471e-936c-cfe1b2670ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.776995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cbe71-7685-471e-936c-cfe1b2670ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.777286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cbe71-7685-471e-936c-cfe1b2670ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.777556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235cbe71-7685-471e-936c-cfe1b2670ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.778222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cbe71-7685-471e-936c-cfe1b2670ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.780165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235cbe71-7685-471e-936c-cfe1b2670ce1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.781528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 782/1584] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.782469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.791501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebc0ef-b5f8-4c7a-a80e-33d4b6dae5fd admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.796162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.796819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.797102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.797369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.798065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.799665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.801743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 803/1585] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.803084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.803390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.803647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.812962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 783/1586] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.812962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.820422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fca2d-a8bc-4818-8679-56e19caeb519 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.822031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:56.823228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:56.825327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.825979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.826260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.826530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.827253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.829223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.830957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 804/1587] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:56.831849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.841214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b3222-8da1-4d2a-918c-5a69e6e0d6d1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.845974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1da4-e10e-448e-a06a-f9f4fb41c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.846623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1da4-e10e-448e-a06a-f9f4fb41c504 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.846945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1da4-e10e-448e-a06a-f9f4fb41c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.847203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1da4-e10e-448e-a06a-f9f4fb41c504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.847920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1da4-e10e-448e-a06a-f9f4fb41c504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.849553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1da4-e10e-448e-a06a-f9f4fb41c504 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.850366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 784/1588] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.851254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.859800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 805/1589] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.860889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40fcf0c-a971-4e96-8914-f90891536982 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.861003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.861222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.861536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.865815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.866442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.866725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.867024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.867710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.869620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.879117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:56.880297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:56.888897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 806/1590] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:56.889759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.890385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 785/1591] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:56 2022] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:56.891035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.899854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71795-3cfd-4a03-b6a7-6eab2565fbf6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.900437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4a247-1a66-41d6-ad6f-efd5e5c4b3fa admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.904678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.904980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.905553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.905674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.905827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.905923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.906093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] PATH_INFO: `/v3/projects/64c2bfd572024b15b35a67a1f39ef0dd/users/f41b71e02756400b87d99195efa608fe/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.906199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.906856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.908467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.918130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 786/1592] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.918970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.921524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c2bfd572024b15b35a67a1f39ef0dd, user_id=f41b71e02756400b87d99195efa608fe, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.924267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.928795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9155a-8ec9-4cf8-99e2-180d234ca35c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:56.934338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:56.935059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:56.935336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:56.935604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:56.936344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:56.938020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:56.939336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 807/1593] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:56 2022] PUT /identity/v3/projects/64c2bfd572024b15b35a67a1f39ef0dd/users/f41b71e02756400b87d99195efa608fe/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:56.940266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.950831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 787/1594] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:56.950831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:56.958113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86e70a-4971-4a45-b151-3b7d5e83e88f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.000239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac8a2-c1c0-48d2-a83c-a6c30ebeac5e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.003950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.004591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.004864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.005129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.012577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.013480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.013767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.014041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.014793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.016500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.026280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 788/1595] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:57.030063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.039378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d339d8-f76c-4479-a5eb-62d1e2de9c27 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.044821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.045462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.045746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.046012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.046718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.048344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.062068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 789/1596] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:57.062068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.062351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.064057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.068932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636477f4-386e-420d-b0f6-d12fed65a4d4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.073484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 808/1597] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:57.074353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.074711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.075036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.075380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.075592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.076310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.077881 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.083454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79def2d-f0da-441d-9609-3cfc561fe8fe service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.088126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be48a1-2a90-4436-a2d0-ff621e160ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.091941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 790/1598] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:57.092075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be48a1-2a90-4436-a2d0-ff621e160ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.092075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be48a1-2a90-4436-a2d0-ff621e160ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.092075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be48a1-2a90-4436-a2d0-ff621e160ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.092331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.101786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb15f7-5b4d-4213-b2f2-fa26039ee03b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.102500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be48a1-2a90-4436-a2d0-ff621e160ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.104570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be48a1-2a90-4436-a2d0-ff621e160ffe service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.107154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.107989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.108336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.108680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.109471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.111091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.114767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 809/1599] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:57.116094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.116392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.116728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.124820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 791/1600] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:57.124820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.134431 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74497f-0d88-4d35-b4df-d7f9c3933c50 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.139511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.140475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.141638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.141638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] PATH_INFO: `/v3/projects/27dd4325dbba41419eb59b0b993fd805/users/2d4857d2d33a41e28dd912548e4577e7/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.145250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] MFA Rules not processed for user `f41b71e02756400b87d99195efa608fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:57.146519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:57.158638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27dd4325dbba41419eb59b0b993fd805, user_id=2d4857d2d33a41e28dd912548e4577e7, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.161736 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.176949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 792/1601] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:57 2022] PUT /identity/v3/projects/27dd4325dbba41419eb59b0b993fd805/users/2d4857d2d33a41e28dd912548e4577e7/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:57.181397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.222929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 810/1602] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:57.223710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.237007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fd807-9b62-47fd-8119-7191add0e14c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.255298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61cd52-f9de-4f4e-8e9d-7aca4d444a5b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.260576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.261247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.261558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.261833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.262745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.264713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.277199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 793/1603] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:57.279190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.290151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e8a88-c66e-4f7e-9818-c611e1a7e1ce admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.295226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.295997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.296513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.296746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.297381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52379828-e652-4c8a-b0a9-1ca9ace8ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.297684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.298322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379828-e652-4c8a-b0a9-1ca9ace8ed1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.298756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379828-e652-4c8a-b0a9-1ca9ace8ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.299036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379828-e652-4c8a-b0a9-1ca9ace8ed1c admin admin] PATH_INFO: `/v3/projects/28a8728becd74499bcce42ca0dbde7c1/users/fe09ce5f923b4823bb5c9e601e853da0/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.299831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.315787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 794/1604] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:57.316304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52379828-e652-4c8a-b0a9-1ca9ace8ed1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a8728becd74499bcce42ca0dbde7c1, user_id=fe09ce5f923b4823bb5c9e601e853da0, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.316808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.319439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52379828-e652-4c8a-b0a9-1ca9ace8ed1c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.328056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959d14b-884c-4006-b977-3a311de516e2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.335383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 811/1605] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:57 2022] PUT /identity/v3/projects/28a8728becd74499bcce42ca0dbde7c1/users/fe09ce5f923b4823bb5c9e601e853da0/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:57.336772 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.337141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.337321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.363050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:57.364317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:57.392303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.393278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.393562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.393838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] PATH_INFO: `/v3/projects/76e08c9379ad43118a23806f1da1f18a/users/9fe1a122817249d59ce515f6651f1c3e/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.413494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e08c9379ad43118a23806f1da1f18a, user_id=9fe1a122817249d59ce515f6651f1c3e, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.417665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.432409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 812/1606] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:57.433910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.444787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7f97-2dfd-4b65-81a5-ef43a53b35fd None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.445833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 795/1607] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:57 2022] PUT /identity/v3/projects/76e08c9379ad43118a23806f1da1f18a/users/9fe1a122817249d59ce515f6651f1c3e/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:57.447117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.505724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.506905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.506905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.507264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.507995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.510122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.516888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7360d4-00e3-434e-995a-5a2f19fcd88b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.530463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccecc2d-364e-42a7-a778-1cef6c3394db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.531065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccecc2d-364e-42a7-a778-1cef6c3394db admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.531393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccecc2d-364e-42a7-a778-1cef6c3394db admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.531676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccecc2d-364e-42a7-a778-1cef6c3394db admin admin] PATH_INFO: `/v3/projects/57ccec31ee3f4845a480759a5772055a/users/2112f845ab0347b099ead44c05a71785/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.544946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 813/1608] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:57.546367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.550316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccecc2d-364e-42a7-a778-1cef6c3394db admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ccec31ee3f4845a480759a5772055a, user_id=2112f845ab0347b099ead44c05a71785, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.553308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccecc2d-364e-42a7-a778-1cef6c3394db admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.568618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 796/1609] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:57 2022] PUT /identity/v3/projects/57ccec31ee3f4845a480759a5772055a/users/2112f845ab0347b099ead44c05a71785/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:57.572556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.572556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.572556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.601294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] MFA Rules not processed for user `fe09ce5f923b4823bb5c9e601e853da0`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:57.602610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:57.625167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52dd9-437b-4e32-bfa1-194bb6841842 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.689034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 797/1610] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:57.690108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.691673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:57.701587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f60c2-099b-42b5-b295-3353e5d8c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.703323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f60c2-099b-42b5-b295-3353e5d8c70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.703705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f60c2-099b-42b5-b295-3353e5d8c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.704041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f60c2-099b-42b5-b295-3353e5d8c70b admin admin] PATH_INFO: `/v3/projects/cf5e9e0befe747a794e1f5372bd1e07c/users/d3271f562474495488835488c6af980f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.732068 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f60c2-099b-42b5-b295-3353e5d8c70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5e9e0befe747a794e1f5372bd1e07c, user_id=d3271f562474495488835488c6af980f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.736208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f60c2-099b-42b5-b295-3353e5d8c70b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.756736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 814/1611] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:57 2022] PUT /identity/v3/projects/cf5e9e0befe747a794e1f5372bd1e07c/users/d3271f562474495488835488c6af980f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:57.768252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.768530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.768809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.769575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e3e08-a55f-4e94-80ca-a9605349a08b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.791108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:57.792484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:57.832739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da5ea1-bb34-4c4e-8e67-051b77b5d607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.833514 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5ea1-bb34-4c4e-8e67-051b77b5d607 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.833906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5ea1-bb34-4c4e-8e67-051b77b5d607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.834916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da5ea1-bb34-4c4e-8e67-051b77b5d607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.873923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 815/1612] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:57.874956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:57.887736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687f64b-328a-4526-8131-4604ae91da7e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:57.894454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47707-955b-4005-a9ce-f20d4d3554bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:57.895656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47707-955b-4005-a9ce-f20d4d3554bc admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.896025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47707-955b-4005-a9ce-f20d4d3554bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.896422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47707-955b-4005-a9ce-f20d4d3554bc admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.897554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47707-955b-4005-a9ce-f20d4d3554bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.899892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47707-955b-4005-a9ce-f20d4d3554bc admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.930284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 816/1613] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/users => generated 309 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:15:57.930284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.930284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.933715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.943733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5ea1-bb34-4c4e-8e67-051b77b5d607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:57.946343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da5ea1-bb34-4c4e-8e67-051b77b5d607 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:57.958485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 798/1614] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:57.959976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90d03-f14f-4342-8a0d-84cb0311e821 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.960261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90d03-f14f-4342-8a0d-84cb0311e821 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.960536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90d03-f14f-4342-8a0d-84cb0311e821 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.962982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 799/1615] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 4 08:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:15:57.965567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:57.966381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:57.966666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:57.970240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:57.975304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:57.997274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:58.000022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 817/1616] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:58.000919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:58.001066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.009862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 800/1617] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:58.010776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.015323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d817-a6fe-4f02-8e11-6ffc8ae63d61 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.022454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16c9bc-d730-45fb-a252-1062369593e3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.024341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.025098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.025438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.025771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.028401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38f70-17cd-43ad-91d5-7ec2b01500c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.029289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38f70-17cd-43ad-91d5-7ec2b01500c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.029718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38f70-17cd-43ad-91d5-7ec2b01500c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.030015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38f70-17cd-43ad-91d5-7ec2b01500c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.030817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38f70-17cd-43ad-91d5-7ec2b01500c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.032861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38f70-17cd-43ad-91d5-7ec2b01500c1 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.045220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.045858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 801/1618] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:58.046811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.048308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.048751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.049233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.069774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 818/1619] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:58.070713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.074128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:58.075645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:58.087938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f26c1f-eca0-4a6e-9b78-14f7fe7d03a5 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.100329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.101325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.101670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.102003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] PATH_INFO: `/v3/projects/6a8d7dad3d704046b9b924961228d31d/users/5940d835def641a08e30f5f61be23dca/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.130495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8d7dad3d704046b9b924961228d31d, user_id=5940d835def641a08e30f5f61be23dca, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.133394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.175103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 819/1620] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:58 2022] PUT /identity/v3/projects/6a8d7dad3d704046b9b924961228d31d/users/5940d835def641a08e30f5f61be23dca/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:58.176268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.182487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 802/1621] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 4 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:58.183622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.193839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6472af-dad3-4464-9e35-5053a3edd982 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.253931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.255573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.256870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.257256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.310265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7342db9-3350-4626-a598-5b1d53860eeb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.320983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.321656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.329645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.330206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.361343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.363598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.389865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 803/1622] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:58.391059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.414490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaeb8f-d1d8-4982-ba85-ec2c10727d87 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.424382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.425274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.425759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.426130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.427004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.428988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.442644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 804/1623] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:15:58.443948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.493394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.498276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.520715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 820/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:58.521638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.540647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f2d79-d1cf-448e-857d-a7efe0efb7b1 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.552986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12256bf9-a41b-4962-9d0e-46c42c078d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.553951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256bf9-a41b-4962-9d0e-46c42c078d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.554268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256bf9-a41b-4962-9d0e-46c42c078d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.554576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256bf9-a41b-4962-9d0e-46c42c078d73 admin admin] PATH_INFO: `/v3/projects/6a8d7dad3d704046b9b924961228d31d/users/5940d835def641a08e30f5f61be23dca/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.559426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12256bf9-a41b-4962-9d0e-46c42c078d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8d7dad3d704046b9b924961228d31d, user_id=5940d835def641a08e30f5f61be23dca, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.564643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12256bf9-a41b-4962-9d0e-46c42c078d73 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.584665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7c82-ac90-465f-a9e1-469f4bf81880 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.590254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 821/1625] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:15:58 2022] PUT /identity/v3/projects/6a8d7dad3d704046b9b924961228d31d/users/5940d835def641a08e30f5f61be23dca/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:15:58.605460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c564e-3ec1-4d95-a5b6-8bd1a45e6c76 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.605782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c564e-3ec1-4d95-a5b6-8bd1a45e6c76 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.606062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c564e-3ec1-4d95-a5b6-8bd1a45e6c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.653832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-027c564e-3ec1-4d95-a5b6-8bd1a45e6c76 None None] MFA Rules not processed for user `5940d835def641a08e30f5f61be23dca`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:58.655072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-027c564e-3ec1-4d95-a5b6-8bd1a45e6c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:58.673202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.674363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.674919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.675440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.781442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.783655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.808882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 805/1626] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:58.822025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 822/1627] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:15:58.832503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:58.903824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2f2d6-2fa8-4225-b6ac-da2e994013e3 service nova] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:58.914722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85534c07-4d42-4572-803d-63fe97038e64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:58.916974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534c07-4d42-4572-803d-63fe97038e64 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:58.917367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534c07-4d42-4572-803d-63fe97038e64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:58.917917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85534c07-4d42-4572-803d-63fe97038e64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:58.945088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534c07-4d42-4572-803d-63fe97038e64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:58.949170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85534c07-4d42-4572-803d-63fe97038e64 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:58.963026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 806/1628] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:59.194792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af3ffa-bc1d-4672-bdb9-14a426767e3f None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:59.195105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af3ffa-bc1d-4672-bdb9-14a426767e3f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:59.195410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af3ffa-bc1d-4672-bdb9-14a426767e3f None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:59.198320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 823/1629] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 4 08:15:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:15:59.205195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:59.205486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:59.205767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:59.227434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:59.228795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:59.246454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 807/1630] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:15:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:15:59.272202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af3ffa-bc1d-4672-bdb9-14a426767e3f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:59.287263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af3ffa-bc1d-4672-bdb9-14a426767e3f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:59.292786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bfa28-13cc-4873-a8f6-0a17d47d3839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:59.293801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bfa28-13cc-4873-a8f6-0a17d47d3839 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:59.294384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bfa28-13cc-4873-a8f6-0a17d47d3839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:59.294931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bfa28-13cc-4873-a8f6-0a17d47d3839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:59.313055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bfa28-13cc-4873-a8f6-0a17d47d3839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:59.314861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:59.328773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bfa28-13cc-4873-a8f6-0a17d47d3839 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:59.356440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 824/1631] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:15:59.410973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b4cd-2e38-43e0-b465-45a851bb8caf None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:15:59.417793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:15:59.419288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:59.419569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:59.420155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] PATH_INFO: `/v3/users/f41b71e02756400b87d99195efa608fe` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:59.421687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41b71e02756400b87d99195efa608fe)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:15:59.422824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: WARNING py.warnings [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:15:59.422824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: warnings.warn(msg) May 04 08:15:59.422824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: May 04 08:15:59.424072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:15:59.514774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41b71e02756400b87d99195efa608fe'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:15:59.526552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41b71e02756400b87d99195efa608fe'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:15:59.558378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41b71e02756400b87d99195efa608fe'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:15:59.560554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41b71e02756400b87d99195efa608fe'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:15:59.612743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fc44e8f8-331e-4c99-abf8-67c37d642b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41b71e02756400b87d99195efa608fe'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:15:59.628590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 808/1632] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:15:59 2022] DELETE /identity/v3/users/f41b71e02756400b87d99195efa608fe => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:15:59.635859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:59.636390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:59.636499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:59.708243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:59.711972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:59.850695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:15:59.851037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:15:59.851522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:15:59.876353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 825/1633] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:15:59.898156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:15:59.900689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:15:59.910279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] MFA Rules not processed for user `2d4857d2d33a41e28dd912548e4577e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:15:59.913977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:00.062573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe81bd-c464-499a-bd4d-d8b302fe95ab None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.071019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.071692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.072050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.072362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.101873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.103502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.119012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 809/1634] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:15:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:00.122153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:00.125510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:00.144798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 826/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:00.153332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286b7f5-4eae-4543-a1b8-9772113a6166 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.160753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.161619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.162000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.163607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.165184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.168355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.217232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 810/1636] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:00 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:00.218457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:00.234000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5113-7c41-4f74-9995-ff4456a72b01 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.417567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.418263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.418537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.418807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.419886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.421968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.455835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 827/1637] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:00 2022] POST /identity/v3/users => generated 309 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:00.456467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:00.475783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8294d80-b16c-44a4-90ff-e9604e56fe99 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.481144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.481838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.482169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.482448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.483283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.484997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.499643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 811/1638] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:16:00.503863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:00.516306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c179e51-3726-4e5d-b94b-4caf316db381 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.526789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.527845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.528121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.528390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] PATH_INFO: `/v3/projects/e73e00f14eb14fe68001526c9faf8de0/users/4dd5fc92546143d196586011c6562133/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.582998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73e00f14eb14fe68001526c9faf8de0, user_id=4dd5fc92546143d196586011c6562133, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.592615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.639434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 828/1639] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:00 2022] PUT /identity/v3/projects/e73e00f14eb14fe68001526c9faf8de0/users/4dd5fc92546143d196586011c6562133/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:00.643482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:00.659239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eca793-dbe8-403d-90e4-0af669ef53fa admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.809588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3d400-86fd-4c4f-9783-cde390451ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.810282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d400-86fd-4c4f-9783-cde390451ada admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.810560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d400-86fd-4c4f-9783-cde390451ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.810832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3d400-86fd-4c4f-9783-cde390451ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.811926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3d400-86fd-4c4f-9783-cde390451ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.813544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3d400-86fd-4c4f-9783-cde390451ada admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.852865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 812/1640] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:00.858825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:00.879789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4e88d-fe6a-4e11-a13d-961610b25e17 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:00.892380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41ea95-2d8c-4a63-a640-cfb31ffacc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:00.893607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ea95-2d8c-4a63-a640-cfb31ffacc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:00.893927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ea95-2d8c-4a63-a640-cfb31ffacc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:00.903123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41ea95-2d8c-4a63-a640-cfb31ffacc82 admin admin] PATH_INFO: `/v3/projects/e73e00f14eb14fe68001526c9faf8de0/users/4dd5fc92546143d196586011c6562133/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:00.911441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41ea95-2d8c-4a63-a640-cfb31ffacc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73e00f14eb14fe68001526c9faf8de0, user_id=4dd5fc92546143d196586011c6562133, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:00.924030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41ea95-2d8c-4a63-a640-cfb31ffacc82 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:00.950981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 829/1641] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:00 2022] PUT /identity/v3/projects/e73e00f14eb14fe68001526c9faf8de0/users/4dd5fc92546143d196586011c6562133/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:01.411077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd44b-8f60-4a5b-96ee-3d56237e0baa None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:01.411644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd44b-8f60-4a5b-96ee-3d56237e0baa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:01.412174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fd44b-8f60-4a5b-96ee-3d56237e0baa None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:01.414122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 813/1642] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 4 08:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:01.422862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d2038-dd7b-4d62-a45a-b574bf8eeb0b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:01.423227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d2038-dd7b-4d62-a45a-b574bf8eeb0b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:01.423566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d2038-dd7b-4d62-a45a-b574bf8eeb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:01.465419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-820d2038-dd7b-4d62-a45a-b574bf8eeb0b None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:01.467666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-820d2038-dd7b-4d62-a45a-b574bf8eeb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:01.624910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 830/1643] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 4 08:16:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:01.630982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539689f-aa86-4cac-881f-977e82a3b0a5 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:01.632469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539689f-aa86-4cac-881f-977e82a3b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:01.633169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539689f-aa86-4cac-881f-977e82a3b0a5 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:01.636277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 814/1644] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 4 08:16:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:01.641835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:01.642338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:01.642562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:01.692955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:01.695714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:01.722017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 831/1645] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:16:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:01.742045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539689f-aa86-4cac-881f-977e82a3b0a5 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:01.744927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6539689f-aa86-4cac-881f-977e82a3b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:01.841989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539689f-aa86-4cac-881f-977e82a3b0a5 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:01.846998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f05fc1-70b0-4fe7-becc-35f247ede94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:01.848577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05fc1-70b0-4fe7-becc-35f247ede94b service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:01.848966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05fc1-70b0-4fe7-becc-35f247ede94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:01.849338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f05fc1-70b0-4fe7-becc-35f247ede94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:01.871524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f05fc1-70b0-4fe7-becc-35f247ede94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:01.873790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f05fc1-70b0-4fe7-becc-35f247ede94b service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:01.910703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 815/1646] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:02.053592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:02.055428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:02.184710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf382f5-a6d4-4bba-945d-1f7bf8ac81ab None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:02.197315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:02.198816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:02.200563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:02.201077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] PATH_INFO: `/v3/projects/64c2bfd572024b15b35a67a1f39ef0dd` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:02.203750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c2bfd572024b15b35a67a1f39ef0dd)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:02.207161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: WARNING py.warnings [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 08:16:02.207161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: warnings.warn(msg) May 04 08:16:02.207161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: May 04 08:16:02.209481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:02.232761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867283bb-e80c-436b-a068-12554e404fb3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:02.233861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867283bb-e80c-436b-a068-12554e404fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:02.234443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867283bb-e80c-436b-a068-12554e404fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:02.299933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-867283bb-e80c-436b-a068-12554e404fb3 None None] MFA Rules not processed for user `d3271f562474495488835488c6af980f`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:02.304227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-867283bb-e80c-436b-a068-12554e404fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:02.356370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c2bfd572024b15b35a67a1f39ef0dd', 'request_id': 'req-e72dc336-ff71-44e7-8e41-969163a420f2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.371399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c2bfd572024b15b35a67a1f39ef0dd', 'request_id': 'req-e72dc336-ff71-44e7-8e41-969163a420f2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.406556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c2bfd572024b15b35a67a1f39ef0dd', 'request_id': 'req-e72dc336-ff71-44e7-8e41-969163a420f2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.433356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] The token cache is being invalidate because project 64c2bfd572024b15b35a67a1f39ef0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:02.433841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.435567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.439450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 832/1647] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:02 2022] DELETE /identity/v3/projects/64c2bfd572024b15b35a67a1f39ef0dd => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:02.443667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:02.449145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:02.473946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 816/1648] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:02.489820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:02.489820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:02.489820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:02.531288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] MFA Rules not processed for user `d3271f562474495488835488c6af980f`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:02.533507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:02.556154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 817/1649] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:02.580461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:02.582538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:02.641718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc336-ff71-44e7-8e41-969163a420f2 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:02.662810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:02.664769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:02.665414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:02.665904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] PATH_INFO: `/v3/users/5940d835def641a08e30f5f61be23dca` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:02.668274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5940d835def641a08e30f5f61be23dca)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:02.674693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:02.770994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c209-1fe6-4651-82d0-cced5fbab2c4 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:02.791368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833e9e1-9575-4714-8a6b-f9446c05fdb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:02.792841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833e9e1-9575-4714-8a6b-f9446c05fdb7 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:02.793276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833e9e1-9575-4714-8a6b-f9446c05fdb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:02.793698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833e9e1-9575-4714-8a6b-f9446c05fdb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:02.799974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5940d835def641a08e30f5f61be23dca'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.824629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5940d835def641a08e30f5f61be23dca'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.831695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833e9e1-9575-4714-8a6b-f9446c05fdb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:02.835400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833e9e1-9575-4714-8a6b-f9446c05fdb7 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:02.881148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 818/1650] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:02.900758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5940d835def641a08e30f5f61be23dca'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.907505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5940d835def641a08e30f5f61be23dca'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.913495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-42ebf8ab-6467-4425-bd59-330dde4d271c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5940d835def641a08e30f5f61be23dca'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:02.983794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 833/1651] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:02 2022] DELETE /identity/v3/users/5940d835def641a08e30f5f61be23dca => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:04.124792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737bada-3c23-460d-812f-40a517c17910 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.125694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737bada-3c23-460d-812f-40a517c17910 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.126137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737bada-3c23-460d-812f-40a517c17910 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.127966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 819/1652] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 4 08:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:04.134649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568212-a1ec-47e7-bdd0-0429c291f402 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.135503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568212-a1ec-47e7-bdd0-0429c291f402 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.136299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68568212-a1ec-47e7-bdd0-0429c291f402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.207216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-68568212-a1ec-47e7-bdd0-0429c291f402 None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:04.208434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-68568212-a1ec-47e7-bdd0-0429c291f402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:04.315346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 834/1653] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:04.336133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737bada-3c23-460d-812f-40a517c17910 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:04.338323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1737bada-3c23-460d-812f-40a517c17910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:04.362724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ff8f-9fbb-4902-b78f-3163d1ecf254 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.363241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ff8f-9fbb-4902-b78f-3163d1ecf254 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.363626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1ff8f-9fbb-4902-b78f-3163d1ecf254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.373863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737bada-3c23-460d-812f-40a517c17910 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:04.393299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:04.394481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.394948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.395368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.408229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:04.410047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:04.426205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-cbd1ff8f-9fbb-4902-b78f-3163d1ecf254 None None] MFA Rules not processed for user `4dd5fc92546143d196586011c6562133`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:04.429661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 820/1654] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:04.430276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cbd1ff8f-9fbb-4902-b78f-3163d1ecf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:04.473605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:04.476009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:04.549654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 835/1655] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:04.587563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec12cac-5cab-40ea-b727-f5e1c541f5db service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:04.593181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:04.594046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.594324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.594593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] PATH_INFO: `/v3/projects/6a8d7dad3d704046b9b924961228d31d` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.598429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8d7dad3d704046b9b924961228d31d)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:04.601057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:04.683515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8d7dad3d704046b9b924961228d31d', 'request_id': 'req-10f5f595-83fc-4ec1-bab7-8101311920cd'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:04.693093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8d7dad3d704046b9b924961228d31d', 'request_id': 'req-10f5f595-83fc-4ec1-bab7-8101311920cd'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:04.708304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8d7dad3d704046b9b924961228d31d', 'request_id': 'req-10f5f595-83fc-4ec1-bab7-8101311920cd'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:04.737928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] The token cache is being invalidate because project 6a8d7dad3d704046b9b924961228d31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:04.738919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:04.740071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-10f5f595-83fc-4ec1-bab7-8101311920cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:04.748305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.749184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.750497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.752382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 821/1656] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:04 2022] DELETE /identity/v3/projects/6a8d7dad3d704046b9b924961228d31d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:04.777689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:04.779874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:04.893510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 836/1657] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:04.893845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.894141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.894417 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.930989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:04.934576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:04.973102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 822/1658] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:04.974335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:04.985298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487ef1e-1aca-4112-aafe-86402b63a478 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:04.992230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:04.993078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:04.993471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:04.993970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:04.994820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:04.995277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:04.997373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:05.028424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:05.040271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b775986-b89d-4bee-a648-bca615bce561 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:05.045716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 837/1659] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:05.052269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:05.052963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.053240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.053509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.058281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:05.060748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:05.138946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 823/1660] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:05 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:05.145952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:05.168250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76ceaa-ec46-4837-b89d-f7de4f95ca26 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:05.285713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:05.287440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.287864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.288265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.289634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:05.292898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:05.321605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 838/1661] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:05 2022] POST /identity/v3/users => generated 279 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:05.332127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:05.343567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc6a1-417d-4827-a40d-843b8c099c27 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:05.370132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:05.371062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.371404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.371749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.372558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:05.374324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:05.396804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 824/1662] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:05.398007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:05.422518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061cb3b-1863-410d-968e-b06f9cfb9d63 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:05.434249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654607-eaa1-440d-b4fd-1fc0fe246191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:05.434997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654607-eaa1-440d-b4fd-1fc0fe246191 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.436358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654607-eaa1-440d-b4fd-1fc0fe246191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.439102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654607-eaa1-440d-b4fd-1fc0fe246191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.440441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654607-eaa1-440d-b4fd-1fc0fe246191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:05.446509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654607-eaa1-440d-b4fd-1fc0fe246191 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:05.492233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 839/1663] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:05.496558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:05.514400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e73ef-d34f-422e-8a6a-d935e08f9162 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:05.528736 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:05.529591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.530020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.530392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] PATH_INFO: `/v3/projects/07dedab2d3a04e289dccec11488fbbd3/users/e1dda088f2ec4c82809353faad5bce0d/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.569741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07dedab2d3a04e289dccec11488fbbd3, user_id=e1dda088f2ec4c82809353faad5bce0d, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:05.573729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:05.606816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 825/1664] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:05 2022] PUT /identity/v3/projects/07dedab2d3a04e289dccec11488fbbd3/users/e1dda088f2ec4c82809353faad5bce0d/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:05.617140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.617575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.617723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.673513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] MFA Rules not processed for user `e1dda088f2ec4c82809353faad5bce0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:05.674790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:05.828673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 840/1665] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:05.832816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:05.958700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09838-3639-471a-b30f-ba26e7ccbcd3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:05.966856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:05.967581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:05.967995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:05.968272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:05.969242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:05.971987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.026629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 826/1666] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:05 2022] POST /identity/v3/projects => generated 355 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:06.030813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.042776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b4705-8ec1-43d5-b4b4-06f67b2a2b89 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.132037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.133982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.134312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.134687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.136021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.139231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.175947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 841/1667] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:06 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:06.179772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.193997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5ae17-b8ce-455b-bfc4-e53609cf86f0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.201142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.202087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.202468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.202844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.203739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.206152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.220597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 827/1668] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:06.224371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.236391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178cf73-0291-4e92-a442-927187c22559 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.242197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce035de-989b-44fb-9e7b-b8d138f190dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.243457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce035de-989b-44fb-9e7b-b8d138f190dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.244140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce035de-989b-44fb-9e7b-b8d138f190dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.245013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce035de-989b-44fb-9e7b-b8d138f190dc admin admin] PATH_INFO: `/v3/projects/8cf1e13ad6bc48aeb2a3f87796815624/users/7e29d9d665ab4deb99fb9bc9211c1a82/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.271325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce035de-989b-44fb-9e7b-b8d138f190dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf1e13ad6bc48aeb2a3f87796815624, user_id=7e29d9d665ab4deb99fb9bc9211c1a82, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.277162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce035de-989b-44fb-9e7b-b8d138f190dc admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.319019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 842/1669] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:06 2022] PUT /identity/v3/projects/8cf1e13ad6bc48aeb2a3f87796815624/users/7e29d9d665ab4deb99fb9bc9211c1a82/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:06.320639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.341497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976a4a6-23a5-4711-84a3-9cfef2f3fe05 None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.341497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976a4a6-23a5-4711-84a3-9cfef2f3fe05 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.341497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976a4a6-23a5-4711-84a3-9cfef2f3fe05 None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.341703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace93c1-f194-4024-b7ed-5c97f06d2e29 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.341779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 843/1670] 10.222.0.59 () {54 vars in 960 bytes} [Wed May 4 08:16:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:06.345643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.345933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.346203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.383122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] MFA Rules not processed for user `89b99e7835d04098ad38e4eee401ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:06.384401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:06.433591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.433797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.434786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.435246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.436087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.438601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.453775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 828/1671] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:06.455229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.470092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a4f0f-5836-4d3d-8916-5f23d662036b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.476910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7301ed-b3d7-46b0-809a-2926c445bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.479081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7301ed-b3d7-46b0-809a-2926c445bb92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.479435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7301ed-b3d7-46b0-809a-2926c445bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.480131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7301ed-b3d7-46b0-809a-2926c445bb92 admin admin] PATH_INFO: `/v3/projects/8cf1e13ad6bc48aeb2a3f87796815624/users/7e29d9d665ab4deb99fb9bc9211c1a82/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.483477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7301ed-b3d7-46b0-809a-2926c445bb92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf1e13ad6bc48aeb2a3f87796815624, user_id=7e29d9d665ab4deb99fb9bc9211c1a82, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.488241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7301ed-b3d7-46b0-809a-2926c445bb92 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.516905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 829/1672] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:06 2022] PUT /identity/v3/projects/8cf1e13ad6bc48aeb2a3f87796815624/users/7e29d9d665ab4deb99fb9bc9211c1a82/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:06.519212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.519501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.523322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.527370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 844/1673] 10.222.0.59 () {58 vars in 1057 bytes} [Wed May 4 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:06.535938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.546602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eca0-07ef-4004-af87-ba8eafe124d5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.581875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] MFA Rules not processed for user `7e29d9d665ab4deb99fb9bc9211c1a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:06.583737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:06.647581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b99e7835d04098ad38e4eee401ea91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.648297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.648679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.649074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.651161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:06.666150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.668336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.680428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 845/1674] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:06.711215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 830/1675] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:06.722002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:06.724109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:06.876009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7a4e4-86a2-4488-a345-5aea8b751352 service placement] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:06.891214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:06.891890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:06.892172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:06.892445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:06.915225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:06.915954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:06.943333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 846/1676] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:06 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:07.156729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:07.204806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7886fd-4732-4d04-99ff-d3b75c18622d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:07.228830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:07.260375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:07.260915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:07.268273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:07.508820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:07.512300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:07.565123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 831/1677] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:08.273988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:08.276109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:08.380965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9e99-08fe-4f5a-9177-7fc479f4af68 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:08.398491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:08.399433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:08.399758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:08.400546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] PATH_INFO: `/v3/users/2d4857d2d33a41e28dd912548e4577e7` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:08.405725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4857d2d33a41e28dd912548e4577e7)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:08.408569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:08.501696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4857d2d33a41e28dd912548e4577e7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:08.514083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4857d2d33a41e28dd912548e4577e7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:08.526785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4857d2d33a41e28dd912548e4577e7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:08.527754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4857d2d33a41e28dd912548e4577e7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:08.529022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4857d2d33a41e28dd912548e4577e7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:08.577127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 847/1678] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:08 2022] DELETE /identity/v3/users/2d4857d2d33a41e28dd912548e4577e7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:08.936136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:08.937620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:08.993501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2ec9-00a6-4e0a-9b2e-d386e4cedd31 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:09.160673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:09.163436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:09.163744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:09.164026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] PATH_INFO: `/v3/users/fe09ce5f923b4823bb5c9e601e853da0` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:09.167023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe09ce5f923b4823bb5c9e601e853da0)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:09.174801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:09.267641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe09ce5f923b4823bb5c9e601e853da0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.279381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:09.284754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:09.294185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe09ce5f923b4823bb5c9e601e853da0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.309518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe09ce5f923b4823bb5c9e601e853da0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.311259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe09ce5f923b4823bb5c9e601e853da0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.334008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d218fa-1cf4-4d74-af17-d097ce894449 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:09.348242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-214a8948-231f-4f9d-9d59-d844cc0fc603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe09ce5f923b4823bb5c9e601e853da0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.365959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 832/1679] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:08 2022] DELETE /identity/v3/users/fe09ce5f923b4823bb5c9e601e853da0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:09.366266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:09.367195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:09.367475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:09.367747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] PATH_INFO: `/v3/projects/27dd4325dbba41419eb59b0b993fd805` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:09.370217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:09.370594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:09.370915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:09.383131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27dd4325dbba41419eb59b0b993fd805)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:09.385407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:09.421754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:09.423041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:09.552723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 833/1680] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:09.575575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27dd4325dbba41419eb59b0b993fd805', 'request_id': 'req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.599748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27dd4325dbba41419eb59b0b993fd805', 'request_id': 'req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.617999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27dd4325dbba41419eb59b0b993fd805', 'request_id': 'req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.639207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:09.640635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:09.659884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] The token cache is being invalidate because project 27dd4325dbba41419eb59b0b993fd805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:09.660178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.663134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.668631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 848/1681] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:09 2022] DELETE /identity/v3/projects/27dd4325dbba41419eb59b0b993fd805 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:09.672238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:09.673693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:09.800503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1f52-a306-4a18-896d-e61711b39f04 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:09.810188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8426ba-e92b-4f7d-b6ca-69d8dbb4f48a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:09.815282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:09.816258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:09.816458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:09.816729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] PATH_INFO: `/v3/users/4dd5fc92546143d196586011c6562133` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:09.818398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd5fc92546143d196586011c6562133)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:09.832908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:09.893371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:09.894507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:09.895804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:09.896893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:09.903416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:09.927203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd5fc92546143d196586011c6562133'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.941408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:09.943361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58fde2-2406-4607-82ac-66b5021e4714 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:09.957501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd5fc92546143d196586011c6562133'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.969093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 834/1682] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:09.973191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd5fc92546143d196586011c6562133'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.974278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd5fc92546143d196586011c6562133'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:09.975660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd5fc92546143d196586011c6562133'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:10.050576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 849/1683] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:09 2022] DELETE /identity/v3/users/4dd5fc92546143d196586011c6562133 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:10.099550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23c416-dec0-4407-81b4-3e59e8b7a4b9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:10.099836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23c416-dec0-4407-81b4-3e59e8b7a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:10.100276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23c416-dec0-4407-81b4-3e59e8b7a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:10.130001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-ea23c416-dec0-4407-81b4-3e59e8b7a4b9 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:10.132761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ea23c416-dec0-4407-81b4-3e59e8b7a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:10.252818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 835/1684] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:10.595747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:10.597242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:10.764943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d007c-0a1f-44ef-bd62-e180622e048c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:10.782263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09558850-2f1e-4b06-a584-b5657a167ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:10.782977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09558850-2f1e-4b06-a584-b5657a167ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:10.783260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09558850-2f1e-4b06-a584-b5657a167ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:10.783530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09558850-2f1e-4b06-a584-b5657a167ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:10.812780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09558850-2f1e-4b06-a584-b5657a167ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:10.814798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09558850-2f1e-4b06-a584-b5657a167ff8 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:10.838381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 850/1685] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:16:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:16:11.142982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:11.143509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:11.144721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:11.213182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] MFA Rules not processed for user `51cf5070eaa549cfa05bcf76848b545b`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:11.214661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:11.416381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 836/1686] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:11.429995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:11.430287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:11.430563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:11.461215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] MFA Rules not processed for user `51cf5070eaa549cfa05bcf76848b545b`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:11.462682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:11.495316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 851/1687] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:11.515365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:11.517521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:11.644727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2239aa-44e2-4834-af2d-bc26f54c0b0f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:11.654559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e990d-40d6-4059-b105-bf9ce8676563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:11.655793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e990d-40d6-4059-b105-bf9ce8676563 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:11.656446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e990d-40d6-4059-b105-bf9ce8676563 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:11.656914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e990d-40d6-4059-b105-bf9ce8676563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:11.688041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e990d-40d6-4059-b105-bf9ce8676563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:11.690357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e990d-40d6-4059-b105-bf9ce8676563 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:11.703492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 837/1688] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:12.761908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:12.763930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:13.074833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a229a7-e1bb-4fb9-8533-1327f8a57c45 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:13.112181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:13.113086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:13.113368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:13.113642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] PATH_INFO: `/v3/projects/e73e00f14eb14fe68001526c9faf8de0` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:13.123649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73e00f14eb14fe68001526c9faf8de0)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:13.125617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:13.244604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73e00f14eb14fe68001526c9faf8de0', 'request_id': 'req-f013e4ba-ce58-4551-846c-d3a05c373677'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:13.265365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73e00f14eb14fe68001526c9faf8de0', 'request_id': 'req-f013e4ba-ce58-4551-846c-d3a05c373677'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:13.299925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73e00f14eb14fe68001526c9faf8de0', 'request_id': 'req-f013e4ba-ce58-4551-846c-d3a05c373677'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:13.360599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] The token cache is being invalidate because project e73e00f14eb14fe68001526c9faf8de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:13.360885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:13.367550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:13.382210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 852/1689] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:12 2022] DELETE /identity/v3/projects/e73e00f14eb14fe68001526c9faf8de0 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:13.382445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c411-2b2b-4f49-a8e5-c6653d49e63d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:13.382956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c411-2b2b-4f49-a8e5-c6653d49e63d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:13.382956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c411-2b2b-4f49-a8e5-c6653d49e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:13.433632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-82b4c411-2b2b-4f49-a8e5-c6653d49e63d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:13.438370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-82b4c411-2b2b-4f49-a8e5-c6653d49e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:13.525255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:13.527715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:13.741213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e4ba-ce58-4551-846c-d3a05c373677 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:13.766228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:13.769032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:13.771810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:13.773319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] PATH_INFO: `/v3/projects/28a8728becd74499bcce42ca0dbde7c1` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:13.782513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a8728becd74499bcce42ca0dbde7c1)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:13.785732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:13.966600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a8728becd74499bcce42ca0dbde7c1', 'request_id': 'req-483d454f-e9d7-4549-b264-8e8930b8c882'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:13.985055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a8728becd74499bcce42ca0dbde7c1', 'request_id': 'req-483d454f-e9d7-4549-b264-8e8930b8c882'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:14.009630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a8728becd74499bcce42ca0dbde7c1', 'request_id': 'req-483d454f-e9d7-4549-b264-8e8930b8c882'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:14.048915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] The token cache is being invalidate because project 28a8728becd74499bcce42ca0dbde7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:14.049211 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:14.057341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-483d454f-e9d7-4549-b264-8e8930b8c882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:14.062412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 853/1690] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:13 2022] DELETE /identity/v3/projects/28a8728becd74499bcce42ca0dbde7c1 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:14.067575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da422-35ef-439e-bd54-f2619c185b5a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.068938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da422-35ef-439e-bd54-f2619c185b5a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.069534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da422-35ef-439e-bd54-f2619c185b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.098430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 838/1691] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 717 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:14.106611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405ac5-18c8-42fb-b9b1-f14c0158b9af None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.107146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405ac5-18c8-42fb-b9b1-f14c0158b9af None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.107579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb405ac5-18c8-42fb-b9b1-f14c0158b9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.118384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-cc9da422-35ef-439e-bd54-f2619c185b5a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:14.122453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cc9da422-35ef-439e-bd54-f2619c185b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:14.158436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-eb405ac5-18c8-42fb-b9b1-f14c0158b9af None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:14.160002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-eb405ac5-18c8-42fb-b9b1-f14c0158b9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:14.296065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 854/1692] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:14.298139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.299043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.299531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.322965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:14.327032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:14.358501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 839/1693] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:14.367559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc357-bb83-4cb9-9b76-2a4ef7922adf None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.370551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc357-bb83-4cb9-9b76-2a4ef7922adf None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.378026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacc357-bb83-4cb9-9b76-2a4ef7922adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.468617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 855/1694] 10.222.0.13 () {58 vars in 1015 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:14.469911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:14.487028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-adacc357-bb83-4cb9-9b76-2a4ef7922adf None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:14.488463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2250629-6bb5-4a29-a0e3-d7a360ef7ad9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:14.489543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-adacc357-bb83-4cb9-9b76-2a4ef7922adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:14.507235 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:14.508400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.509196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.510081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.511793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:14.512334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:14.514834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:14.525680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 840/1695] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:14.532175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.532678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.534019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.539847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 856/1696] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:14.543091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:14.581864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c8d20-4588-4e20-a659-2ceee81afd27 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:14.609421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:14.613052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.613445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.613851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.618202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:14.618634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:14.622299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:14.625271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] MFA Rules not processed for user `090f701bb7e54a72ab9a5c84fba01fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:14.626738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:14.654316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 857/1697] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:14.658630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:14.678111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb308b6-1ec3-411a-ab76-01673d401909 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:14.694591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:14.698427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.698713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.699623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.700339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:14.702277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:14.778691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 841/1698] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:14.779808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:14.811892 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7e744-c41f-4d06-bb50-52f2a1cfa944 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:14.821669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 858/1699] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:14.829770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:14.832941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:14.839043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:14.839787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:14.840075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:14.840392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:14.841139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:14.843335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:14.927869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 842/1700] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:14 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:14.928966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:14.935512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:15.006657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab412e4-c20b-426f-bebb-6be842789453 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.122089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7312c40-f42d-49e9-a62d-0365ee6df6f9 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.148134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.148911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.149215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.149491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.231294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.231982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.232258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.232526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.251750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.253241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.286452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 859/1701] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:15.287535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.315190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.319661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.352759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 843/1702] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:15.361175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.535805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790f7a-7003-42b2-8fd3-9d4c64bf6fa9 service nova] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.559615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.560396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.560626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.561064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.561793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.563862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.613330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629fb7c-873f-45d5-b479-d49aad2683d5 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.640477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.641689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.642174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.642654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.643594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.645768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.650798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 844/1703] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:15 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:15.653534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.687682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfc8e8-15c7-40dc-b5ee-9ee57e5f78a8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.722257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 860/1704] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:15 2022] POST /identity/v3/users => generated 283 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:15.723655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.727556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.729111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.730005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.730319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.737696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.744560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.761366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ba16f-0bdb-4aad-bfb1-18bd8f99b3b4 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.771261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.772056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.775125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.775523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.776439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.776909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 845/1705] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:15.779139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.789496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.809427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 861/1706] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:15.814630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.839308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fa184-544b-4814-98b3-d245e9944cf8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.846334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037150e-0d07-4b74-9ba4-59b2a1ff72e3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.864300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.865261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.865613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.867919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.868772 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.873194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.877236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.879851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.883285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.883833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.885710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:15.902360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:15.920361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 862/1707] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:15.921464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.947957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897aa35-fba0-41ab-b750-e4e1bb76d128 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:15.967929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 846/1708] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:15.969268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:15.982110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d7a9f-adb4-4093-9ad6-6517ec21fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:15.985666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d7a9f-adb4-4093-9ad6-6517ec21fbab admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:15.986036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d7a9f-adb4-4093-9ad6-6517ec21fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:15.986715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d7a9f-adb4-4093-9ad6-6517ec21fbab admin admin] PATH_INFO: `/v3/projects/b9dec49aae264cba9bbe4613b5bd27a1/users/ca7b01fb860c4f48aa30442918de09f2/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:15.998441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95c88-cc5d-43f1-b452-ee418e95da9b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:16.018693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0c64c-8c90-4848-804f-0a0574f49563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:16.026632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c64c-8c90-4848-804f-0a0574f49563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:16.028318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c64c-8c90-4848-804f-0a0574f49563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:16.028611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c64c-8c90-4848-804f-0a0574f49563 admin admin] PATH_INFO: `/v3/projects/2e876d53d2e4492b90302071d654c9d1/users/87ddbf1613fa41bf93f1001442a5f84e/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:16.049272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d7a9f-adb4-4093-9ad6-6517ec21fbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9dec49aae264cba9bbe4613b5bd27a1, user_id=ca7b01fb860c4f48aa30442918de09f2, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:16.062246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d7a9f-adb4-4093-9ad6-6517ec21fbab admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:16.083564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0c64c-8c90-4848-804f-0a0574f49563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e876d53d2e4492b90302071d654c9d1, user_id=87ddbf1613fa41bf93f1001442a5f84e, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:16.093288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0c64c-8c90-4848-804f-0a0574f49563 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:16.098392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 863/1709] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:15 2022] PUT /identity/v3/projects/b9dec49aae264cba9bbe4613b5bd27a1/users/ca7b01fb860c4f48aa30442918de09f2/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:16.110497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:16.111089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:16.111372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:16.147005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 847/1710] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:15 2022] PUT /identity/v3/projects/2e876d53d2e4492b90302071d654c9d1/users/87ddbf1613fa41bf93f1001442a5f84e/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:16.164407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:16.164760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:16.165038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:16.176014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] MFA Rules not processed for user `ca7b01fb860c4f48aa30442918de09f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:16.183965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:16.288538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] MFA Rules not processed for user `87ddbf1613fa41bf93f1001442a5f84e`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:16.289736 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:16.456692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 864/1711] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:16.457963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:16.607123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf6da-c15e-4c81-9b0e-69918ebb5b3f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:16.616057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:16.616801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:16.617123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:16.617441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:16.618141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:16.621826 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 848/1712] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:16.626129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:16.673030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 865/1713] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:16 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:16.677151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:16.690442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfa32-0b17-46dc-9f8a-e518d4d211cb None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:16.919793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:16.920507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:16.920788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:16.921051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:16.921765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:16.923786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:17.007470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:17.009954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 849/1714] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:16 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:17.021146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73c0a-ccb1-4d31-8d14-bba4dd6af85e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:17.044888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:17.045962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.046459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.046984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:17.052351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:17.060731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:17.099869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:17.101682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 866/1715] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:17.127501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05621737-4eec-4594-a5da-1bdc1b0d2533 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:17.152134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f66fa-3bc9-4aca-be74-737330092fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:17.153869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f66fa-3bc9-4aca-be74-737330092fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.156497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f66fa-3bc9-4aca-be74-737330092fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.156937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f66fa-3bc9-4aca-be74-737330092fb5 admin admin] PATH_INFO: `/v3/projects/19d9de54e8704255822d7d78ba221f43/users/71e36e4ce1f44f3db49a09cbd12ad559/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:17.240200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f66fa-3bc9-4aca-be74-737330092fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d9de54e8704255822d7d78ba221f43, user_id=71e36e4ce1f44f3db49a09cbd12ad559, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:17.252598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f66fa-3bc9-4aca-be74-737330092fb5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:17.313626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 850/1716] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:17 2022] PUT /identity/v3/projects/19d9de54e8704255822d7d78ba221f43/users/71e36e4ce1f44f3db49a09cbd12ad559/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:17.314432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:17.329857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c942e-e44e-4898-8a64-60668e27a7cf admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:17.366432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.366432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.366682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:17.488945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] MFA Rules not processed for user `51cf5070eaa549cfa05bcf76848b545b`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:17.488945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:17.569100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:17.569711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.569988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.570259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:17.571020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:17.572879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:17.614642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 867/1717] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:17.616448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:17.757637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 851/1718] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:17.758257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:17.825187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6df651-0af0-4b3e-b599-c85debc67e70 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:17.858160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c358f-de87-417d-9f07-a5b1051efddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:17.888039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c358f-de87-417d-9f07-a5b1051efddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.889765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c358f-de87-417d-9f07-a5b1051efddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.890258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c358f-de87-417d-9f07-a5b1051efddc admin admin] PATH_INFO: `/v3/projects/19d9de54e8704255822d7d78ba221f43/users/71e36e4ce1f44f3db49a09cbd12ad559/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:17.899203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c358f-de87-417d-9f07-a5b1051efddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d9de54e8704255822d7d78ba221f43, user_id=71e36e4ce1f44f3db49a09cbd12ad559, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:17.913220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c358f-de87-417d-9f07-a5b1051efddc admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:17.915717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2b7f4-ab84-485a-a998-502d66b8faa0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:17.944263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:17.949917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.949917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.949917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:17.977112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 852/1719] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:17 2022] PUT /identity/v3/projects/19d9de54e8704255822d7d78ba221f43/users/71e36e4ce1f44f3db49a09cbd12ad559/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:17.980136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:17.980430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:17.980725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:18.120659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] MFA Rules not processed for user `71e36e4ce1f44f3db49a09cbd12ad559`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:18.128655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:18.212107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:18.228307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:18.269533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 868/1720] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:18.540838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 853/1721] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 558 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:18.549597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:18.552581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:18.713113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c259-0aae-42f6-9cd9-24594176fcd2 service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:18.757875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:18.848623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:18.852665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:18.854414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:18.855600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:18.884090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:18.886115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:18.910239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 869/1722] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:19.077738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13303fb-0861-4e2f-843e-804db5c64007 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:19.084281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:19.086684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:19.087314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:19.088953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] PATH_INFO: `/v3/users/87ddbf1613fa41bf93f1001442a5f84e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:19.093211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ddbf1613fa41bf93f1001442a5f84e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:19.100531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:19.263213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:19.282416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97342e85-1a51-4bb9-8f33-a2803d84b759 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:19.302347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:19.303147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ddbf1613fa41bf93f1001442a5f84e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:19.304211 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:19.307564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:19.308464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:19.327105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ddbf1613fa41bf93f1001442a5f84e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:19.348555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ddbf1613fa41bf93f1001442a5f84e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:19.350810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ddbf1613fa41bf93f1001442a5f84e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:19.392243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b3ff584c-bd14-4c44-95b2-a33e6f85787b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ddbf1613fa41bf93f1001442a5f84e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:19.417323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 854/1723] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:18 2022] DELETE /identity/v3/users/87ddbf1613fa41bf93f1001442a5f84e => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:19.420058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b419e7-2485-4371-9de9-62d0dca8bf1d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:19.420808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b419e7-2485-4371-9de9-62d0dca8bf1d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:19.420808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b419e7-2485-4371-9de9-62d0dca8bf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:19.519407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-99b419e7-2485-4371-9de9-62d0dca8bf1d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:19.523544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-99b419e7-2485-4371-9de9-62d0dca8bf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:19.535909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:19.537617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:19.573882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 870/1724] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:19.751703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 855/1725] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:19.956282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:19.958638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:20.299805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f2a49-26a3-4e8e-bccf-245686932922 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:20.528944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:20.529831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:20.530272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:20.530714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:20.563155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:20.567840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:20.595848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 871/1726] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:22.784866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978910-131c-414e-929c-5416ca579e70 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:22.785367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978910-131c-414e-929c-5416ca579e70 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:22.785454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978910-131c-414e-929c-5416ca579e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:22.880069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-28978910-131c-414e-929c-5416ca579e70 None None] MFA Rules not processed for user `2112f845ab0347b099ead44c05a71785`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:22.881474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-28978910-131c-414e-929c-5416ca579e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:23.169449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 856/1727] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:23.349763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:23.352366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:23.370691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e358-06c3-41c5-aebc-1eb83dd37c8d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:23.371120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e358-06c3-41c5-aebc-1eb83dd37c8d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:23.371448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189e358-06c3-41c5-aebc-1eb83dd37c8d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:23.373132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 857/1728] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:16:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:23.469752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:23.470369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:23.471010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:23.524165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:23.530469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:23.758026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e853-0ede-4127-b2fe-1da43fb4ff91 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:23.793605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:23.794314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:23.798011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:23.799513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:23.804655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 858/1729] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:16:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:23.809083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:23.816357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:23.845480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:23.859947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:23.866014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da249903-33a2-41f4-9a90-6ed26a182295 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:23.893966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:23.895307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:23.901014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:23.901528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] PATH_INFO: `/v3/projects/2e876d53d2e4492b90302071d654c9d1` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:23.908729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e876d53d2e4492b90302071d654c9d1)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:23.911854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:23.939063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 872/1730] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:23.940094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:23.955348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:24.006862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd02204-47b6-4e6b-b09a-c36297b48674 service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:24.027600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17159c-a9a2-4c9c-b8b7-2c47740538c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:24.028489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17159c-a9a2-4c9c-b8b7-2c47740538c0 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:24.028922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17159c-a9a2-4c9c-b8b7-2c47740538c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:24.029331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17159c-a9a2-4c9c-b8b7-2c47740538c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:24.064734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17159c-a9a2-4c9c-b8b7-2c47740538c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:24.068823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17159c-a9a2-4c9c-b8b7-2c47740538c0 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:24.107308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 873/1731] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:24.124641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:24.128880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:24.135363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:24.202165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e876d53d2e4492b90302071d654c9d1', 'request_id': 'req-5a2f9f65-c813-4b22-9697-73a0a83213a2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:24.233032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e876d53d2e4492b90302071d654c9d1', 'request_id': 'req-5a2f9f65-c813-4b22-9697-73a0a83213a2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:24.256285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] MFA Rules not processed for user `9fe1a122817249d59ce515f6651f1c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:24.261542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:24.285716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e876d53d2e4492b90302071d654c9d1', 'request_id': 'req-5a2f9f65-c813-4b22-9697-73a0a83213a2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:24.353531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] The token cache is being invalidate because project 2e876d53d2e4492b90302071d654c9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:24.354133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:24.355213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5a2f9f65-c813-4b22-9697-73a0a83213a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:24.367794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 859/1732] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:23 2022] DELETE /identity/v3/projects/2e876d53d2e4492b90302071d654c9d1 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:24.372815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045013-1837-4a3c-9115-e586e7209b74 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:24.373119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045013-1837-4a3c-9115-e586e7209b74 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:24.377227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045013-1837-4a3c-9115-e586e7209b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:24.436246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-ba045013-1837-4a3c-9115-e586e7209b74 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:24.443411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ba045013-1837-4a3c-9115-e586e7209b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:24.562570 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 860/1733] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:24.584273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:24.584565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:24.584838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:24.681818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 874/1734] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 558 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:24.694571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:24.696226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:24.707353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:24.709026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:24.770525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 861/1735] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:24.777349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:24.826022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9477d-49ac-4ca9-bf63-98065a6a5bdf None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:24.888581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:24.889340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:24.889618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:24.889894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:24.890668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:24.903214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:24.904978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:24.942326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 862/1736] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:24.955653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:25.003178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b962-c1a2-41e6-8909-ecbf58eeb21a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:25.030804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:25.031543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.031820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.032090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.032804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:25.050328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:25.156737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5a0b4-ea54-49a1-bd3f-ee528359970e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:25.160024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 863/1737] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:24 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:25.164983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:25.184393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:25.185097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.185371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.186975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.217384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:25.228808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:25.265050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 875/1738] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:25.412875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd150-d28d-48d8-b45c-7e6ab7a09ae9 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:25.438782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:25.439753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.440193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.440626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.441466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:25.446849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:25.516348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 864/1739] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:25 2022] POST /identity/v3/users => generated 287 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:25.520341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:25.547292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86150bd-3d9d-4e56-882f-5cea31cc9766 service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:25.562229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:25.563269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.563636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.564192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.565709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:25.576785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:25.611466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:25.625462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 876/1740] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:25.625882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c57d-2027-466d-912f-561fa87c363a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:25.632905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6180d0c-8b96-43e7-ae38-46f76f7d0cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:25.634227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180d0c-8b96-43e7-ae38-46f76f7d0cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.634666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180d0c-8b96-43e7-ae38-46f76f7d0cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.636143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6180d0c-8b96-43e7-ae38-46f76f7d0cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.639040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6180d0c-8b96-43e7-ae38-46f76f7d0cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:25.641093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6180d0c-8b96-43e7-ae38-46f76f7d0cb5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:25.663866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 865/1741] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:25.667814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:25.678990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62347a89-630d-43a3-8970-e4c2238b33a5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:25.708908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:25.709842 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.710115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.710575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] PATH_INFO: `/v3/projects/0388e4eb20d64f5bac06fca5e36fbdc2/users/64102990c0094dab90eb30b71155244b/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.762953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0388e4eb20d64f5bac06fca5e36fbdc2, user_id=64102990c0094dab90eb30b71155244b, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:25.765697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:25.810700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 877/1742] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:25 2022] PUT /identity/v3/projects/0388e4eb20d64f5bac06fca5e36fbdc2/users/64102990c0094dab90eb30b71155244b/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:25.822730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:25.823295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:25.823726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:25.927110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] MFA Rules not processed for user `64102990c0094dab90eb30b71155244b`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:25.930729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:26.183780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 866/1743] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:26.187751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:26.318613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f462-ba23-4cfe-ba3a-d51d10ee1dce admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:26.326259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:26.327381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:26.327886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:26.328344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:26.329285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:26.331668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:26.439851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 878/1744] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:26 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:26.443913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:26.478315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b3760-997c-4ad2-a22f-2c8fec7ab250 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:26.669010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:26.669739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:26.670023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:26.670295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:26.671051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:26.673078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:26.748350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:26.750484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 867/1745] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:26 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:26.786980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c902e-100a-48c7-a971-f6cffbc7890d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:26.817898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:26.818834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:26.823380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:26.823837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:26.824836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:26.826682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:26.855441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 879/1746] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:26.857619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:26.870814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8166a-0183-4ea9-b7de-fdabed70b048 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:26.921224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:26.922476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:26.923048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:26.923767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] PATH_INFO: `/v3/projects/afe3c4b0bda64528b8c59ee607592816/users/832d25a1056240e59fe040295aeaae2b/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:26.957650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe3c4b0bda64528b8c59ee607592816, user_id=832d25a1056240e59fe040295aeaae2b, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:26.961122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:27.055591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 868/1747] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:26 2022] PUT /identity/v3/projects/afe3c4b0bda64528b8c59ee607592816/users/832d25a1056240e59fe040295aeaae2b/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:27.056080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:27.067797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83f27-8f1a-4ecf-99ce-d60a0993848e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:27.219700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef6a5a-97fd-4551-84a2-7b3d8c35a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:27.221076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6a5a-97fd-4551-84a2-7b3d8c35a32b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:27.221590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6a5a-97fd-4551-84a2-7b3d8c35a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:27.222045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6a5a-97fd-4551-84a2-7b3d8c35a32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:27.223025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef6a5a-97fd-4551-84a2-7b3d8c35a32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:27.224883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef6a5a-97fd-4551-84a2-7b3d8c35a32b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:27.247158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 880/1748] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:27.251121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:27.265882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9eac4-55c5-4d0d-93c4-e5b0fa365234 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:27.272538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:27.273867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:27.274356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:27.275192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] PATH_INFO: `/v3/projects/afe3c4b0bda64528b8c59ee607592816/users/832d25a1056240e59fe040295aeaae2b/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:27.277786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe3c4b0bda64528b8c59ee607592816, user_id=832d25a1056240e59fe040295aeaae2b, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:27.288629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:27.315411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:27.315937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:27.316566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:27.334371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 869/1749] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:27 2022] PUT /identity/v3/projects/afe3c4b0bda64528b8c59ee607592816/users/832d25a1056240e59fe040295aeaae2b/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:27.364000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] MFA Rules not processed for user `832d25a1056240e59fe040295aeaae2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:27.366643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:27.577983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 881/1750] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:27.594114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:27.596582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:27.824039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541e78-2e1f-4b04-a6e9-2c93fe642c8a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:27.835235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6c164-c4d3-447c-876a-1b9637c392be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:27.837596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6c164-c4d3-447c-876a-1b9637c392be service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:27.842576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6c164-c4d3-447c-876a-1b9637c392be service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:27.842871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6c164-c4d3-447c-876a-1b9637c392be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:27.874118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6c164-c4d3-447c-876a-1b9637c392be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:27.876047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6c164-c4d3-447c-876a-1b9637c392be service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:27.949835 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 870/1751] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:28.093914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:28.106569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b820bf-95ca-43fd-8ca5-128b3110953d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:28.120145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:28.121526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:28.121971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:28.122376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:28.258182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:28.260242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:28.276919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 882/1752] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:28.391878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5064-c2db-40b0-b153-e5ade915076c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:28.392846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5064-c2db-40b0-b153-e5ade915076c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:28.393247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f5064-c2db-40b0-b153-e5ade915076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:28.419407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-640f5064-c2db-40b0-b153-e5ade915076c None None] MFA Rules not processed for user `090f701bb7e54a72ab9a5c84fba01fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:28.420925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-640f5064-c2db-40b0-b153-e5ade915076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:28.559840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 871/1753] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:30.586238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:30.588004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:30.759026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294b392-16c7-4b98-89ba-3d8c4089a9dc service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:30.771956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:30.772867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:30.773145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:30.773420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] PATH_INFO: `/v3/users/e1dda088f2ec4c82809353faad5bce0d` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:30.776912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dda088f2ec4c82809353faad5bce0d)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:30.783097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:30.892916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dda088f2ec4c82809353faad5bce0d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:30.930480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dda088f2ec4c82809353faad5bce0d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:30.947327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dda088f2ec4c82809353faad5bce0d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:30.948561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dda088f2ec4c82809353faad5bce0d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:30.949562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dda088f2ec4c82809353faad5bce0d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:30.994077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 883/1754] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:30 2022] DELETE /identity/v3/users/e1dda088f2ec4c82809353faad5bce0d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:31.000084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:31.003248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:31.003563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:31.027396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:31.029029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:31.143299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 872/1755] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:31.197917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:31.199955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:31.338684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa61d5-41aa-4f4b-a3ea-e3af21165ff5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:31.350202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c036-98af-4d91-9559-0b0b61df8878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:31.350931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c036-98af-4d91-9559-0b0b61df8878 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:31.351454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c036-98af-4d91-9559-0b0b61df8878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:31.351993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c036-98af-4d91-9559-0b0b61df8878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:31.373768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65c036-98af-4d91-9559-0b0b61df8878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:31.377004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65c036-98af-4d91-9559-0b0b61df8878 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:31.412533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 884/1756] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:32.563474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:32.565261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:32.579254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2ecc6-eba7-4c0c-b5a0-a9c7d75e9aa7 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:32.590584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:32.592268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:32.592779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:32.593260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] PATH_INFO: `/v3/users/ca7b01fb860c4f48aa30442918de09f2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:32.595209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7b01fb860c4f48aa30442918de09f2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:32.597834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:32.660657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7b01fb860c4f48aa30442918de09f2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:32.676865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7b01fb860c4f48aa30442918de09f2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:32.687567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7b01fb860c4f48aa30442918de09f2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:32.688811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7b01fb860c4f48aa30442918de09f2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:32.704627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-cdd51a4f-903c-45f5-9c4c-cdb3b0e5ff9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7b01fb860c4f48aa30442918de09f2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:32.712738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 873/1757] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:32 2022] DELETE /identity/v3/users/ca7b01fb860c4f48aa30442918de09f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:32.718966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:32.720516 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:32.721002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:32.750077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:32.753183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:32.794470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:32.795536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:32.796086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:32.837937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] MFA Rules not processed for user `2112f845ab0347b099ead44c05a71785`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:32.838909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:32.875395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 885/1758] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:32.895441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:32.897930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:32.991510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 874/1759] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:33.000439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:33.003808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:33.036285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230c92d-c8e6-455a-9be0-feefcefe84ad None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:33.044051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb186b-0596-4413-8386-daf33cbbf437 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:33.058157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:33.061105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:33.061697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:33.062172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] PATH_INFO: `/v3/projects/07dedab2d3a04e289dccec11488fbbd3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:33.067075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07dedab2d3a04e289dccec11488fbbd3)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:33.067632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:33.068341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:33.068621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:33.068898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:33.070411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:33.100619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:33.102295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:33.114725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 886/1760] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:33.197180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07dedab2d3a04e289dccec11488fbbd3', 'request_id': 'req-ba645053-9575-4fcc-8702-a4294f779607'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.216256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07dedab2d3a04e289dccec11488fbbd3', 'request_id': 'req-ba645053-9575-4fcc-8702-a4294f779607'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.234907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07dedab2d3a04e289dccec11488fbbd3', 'request_id': 'req-ba645053-9575-4fcc-8702-a4294f779607'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.257765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] The token cache is being invalidate because project 07dedab2d3a04e289dccec11488fbbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:33.258203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.259117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba645053-9575-4fcc-8702-a4294f779607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.264253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 875/1761] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:32 2022] DELETE /identity/v3/projects/07dedab2d3a04e289dccec11488fbbd3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:33.265370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:33.286744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a798-26ac-48c9-af1f-3cdb47680af0 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:33.417184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:33.419003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:33.419457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:33.419996 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] PATH_INFO: `/v3/users/7e29d9d665ab4deb99fb9bc9211c1a82` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:33.421954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e29d9d665ab4deb99fb9bc9211c1a82)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:33.424119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:33.516891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e29d9d665ab4deb99fb9bc9211c1a82'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.538660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e29d9d665ab4deb99fb9bc9211c1a82'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.547739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e29d9d665ab4deb99fb9bc9211c1a82'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.548482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e29d9d665ab4deb99fb9bc9211c1a82'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.549059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e29d9d665ab4deb99fb9bc9211c1a82'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:33.572925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 887/1762] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:33 2022] DELETE /identity/v3/users/7e29d9d665ab4deb99fb9bc9211c1a82 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:33.725975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:33.726502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:33.726633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:33.752701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] MFA Rules not processed for user `9fe1a122817249d59ce515f6651f1c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:33.754351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:33.864460 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 876/1763] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:33.950655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:33.952310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:34.133449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:34.135218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:34.155042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605dbdf-cdf7-4965-a9d5-83f21a9c4c59 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:34.165576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:34.166789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.167340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.167885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] PATH_INFO: `/v3/projects/8cf1e13ad6bc48aeb2a3f87796815624` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.169563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf1e13ad6bc48aeb2a3f87796815624)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:34.171803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:34.283596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf1e13ad6bc48aeb2a3f87796815624', 'request_id': 'req-758fc82a-3785-447e-b5ef-8b05e76b796a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.292741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ae08-dcac-40db-8fea-8c2fbb871902 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:34.295977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf1e13ad6bc48aeb2a3f87796815624', 'request_id': 'req-758fc82a-3785-447e-b5ef-8b05e76b796a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.305774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf1e13ad6bc48aeb2a3f87796815624', 'request_id': 'req-758fc82a-3785-447e-b5ef-8b05e76b796a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.323683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] The token cache is being invalidate because project 8cf1e13ad6bc48aeb2a3f87796815624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:34.324463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.325357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-758fc82a-3785-447e-b5ef-8b05e76b796a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.331882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 888/1764] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:33 2022] DELETE /identity/v3/projects/8cf1e13ad6bc48aeb2a3f87796815624 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:34.333646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad5af-8968-4cf5-a53f-af006a5a6132 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.334095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad5af-8968-4cf5-a53f-af006a5a6132 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.334375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bad5af-8968-4cf5-a53f-af006a5a6132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.359164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-18bad5af-8968-4cf5-a53f-af006a5a6132 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:34.360762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-18bad5af-8968-4cf5-a53f-af006a5a6132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:34.400754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:34.401976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.402421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.402782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] PATH_INFO: `/v3/projects/b9dec49aae264cba9bbe4613b5bd27a1` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.404398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9dec49aae264cba9bbe4613b5bd27a1)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:34.406602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:34.483357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 889/1765] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:34.485497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.491309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.491752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.549767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dec49aae264cba9bbe4613b5bd27a1', 'request_id': 'req-13e443f8-204f-46d8-87a8-52c9a8ef0681'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.554808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:34.557054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:34.567863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dec49aae264cba9bbe4613b5bd27a1', 'request_id': 'req-13e443f8-204f-46d8-87a8-52c9a8ef0681'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.581596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dec49aae264cba9bbe4613b5bd27a1', 'request_id': 'req-13e443f8-204f-46d8-87a8-52c9a8ef0681'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.596155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] The token cache is being invalidate because project b9dec49aae264cba9bbe4613b5bd27a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:34.596905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.597719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.601108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 877/1766] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:34 2022] DELETE /identity/v3/projects/b9dec49aae264cba9bbe4613b5bd27a1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:34.605432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:34.607176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:34.712622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 890/1767] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:34.717198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:34.727734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9e125-8fd8-4206-8dcf-cb6f011575fe None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:34.733945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:34.734768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.735186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.735552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.735724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e443f8-204f-46d8-87a8-52c9a8ef0681 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:34.736615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:34.737010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:34.738837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:34.740611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:34.741696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.741982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.742255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] PATH_INFO: `/v3/users/71e36e4ce1f44f3db49a09cbd12ad559` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.743522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e36e4ce1f44f3db49a09cbd12ad559)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:34.745871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:34.758058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 891/1768] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:16:34.759176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:34.770780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f278c-7448-4988-a491-840a293d5a43 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:34.785435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:34.786936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:34.786936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:34.787186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:34.787873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:34.793550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:34.818568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e36e4ce1f44f3db49a09cbd12ad559'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.832916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e36e4ce1f44f3db49a09cbd12ad559'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.847772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e36e4ce1f44f3db49a09cbd12ad559'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.848755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e36e4ce1f44f3db49a09cbd12ad559'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.850218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 892/1769] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:34 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:34.854715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:34.857358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:34.872723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e36e4ce1f44f3db49a09cbd12ad559'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:34.883146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 878/1770] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:34 2022] DELETE /identity/v3/users/71e36e4ce1f44f3db49a09cbd12ad559 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:34.965954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251be2d-5398-4d24-81d4-383d1adc028c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:35.055639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:35.057309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.057737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.058559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.059515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:35.061616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:35.105246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 893/1771] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:34 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:35.110055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:35.127232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e9c9-35c7-4fc4-87da-804cb3562a8a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:35.138947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:35.140388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.141271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.142412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.144899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:35.149318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:35.166451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 879/1772] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:35.170315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:35.191489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6652f-45eb-45aa-88dd-31e98f06d2d0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:35.201745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027129a-e943-4b1e-8db1-7c18be4d1c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:35.203553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027129a-e943-4b1e-8db1-7c18be4d1c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.203964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027129a-e943-4b1e-8db1-7c18be4d1c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.204419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027129a-e943-4b1e-8db1-7c18be4d1c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.205875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027129a-e943-4b1e-8db1-7c18be4d1c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:35.208656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027129a-e943-4b1e-8db1-7c18be4d1c44 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:35.230542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 894/1773] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:16:35.233789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:35.257629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6c1e-b754-4feb-8684-afd31faf0013 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:35.264726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f40ea-acbe-4d35-9ada-954026e9d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:35.266190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f40ea-acbe-4d35-9ada-954026e9d81b admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.266190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f40ea-acbe-4d35-9ada-954026e9d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.266587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f40ea-acbe-4d35-9ada-954026e9d81b admin admin] PATH_INFO: `/v3/projects/ea68d3c351b54ec0a7f40271756914ad/users/3280f94980364753b4cf275dd83fafe2/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.303783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f40ea-acbe-4d35-9ada-954026e9d81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea68d3c351b54ec0a7f40271756914ad, user_id=3280f94980364753b4cf275dd83fafe2, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:35.311898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f40ea-acbe-4d35-9ada-954026e9d81b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:35.344415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.344874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 880/1774] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:35 2022] PUT /identity/v3/projects/ea68d3c351b54ec0a7f40271756914ad/users/3280f94980364753b4cf275dd83fafe2/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:35.345325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.345981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.395168 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ac58b-ebac-41a1-9fb7-b14468c3aa50 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.395557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ac58b-ebac-41a1-9fb7-b14468c3aa50 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.396011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ac58b-ebac-41a1-9fb7-b14468c3aa50 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.397947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 881/1775] 10.222.0.59 () {54 vars in 912 bytes} [Wed May 4 08:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:35.408112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] MFA Rules not processed for user `3280f94980364753b4cf275dd83fafe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:35.409087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:35.412034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.412413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.412797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.440066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:35.457415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:35.575501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 882/1776] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:35.588217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:35.591853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:35.615620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7324a-30bb-4656-be1a-5d66e18e5f06 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:35.625069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:35.630565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:35.631010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:35.631293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:35.648591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:35.652583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:35.666303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 883/1777] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:35.977047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 895/1778] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 634 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:35.982531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:36.069479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1e656-d6a2-4b93-be6a-0e2e375ef010 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:36.076641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:36.077370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:36.077648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:36.077914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:36.080104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:36.083744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:36.123988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 884/1779] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:35 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:36.124622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:36.140751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a16bbe-f8b5-4004-a299-12f48200efb0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:36.279579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:36.283515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:36.285643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:36.288710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:36.291103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:36.296583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:36.349926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 896/1780] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:36 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:36.354926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:36.373135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c1993-c5e5-4bad-a435-2e615f9d790d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:36.388916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:36.389892 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:36.390172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:36.390532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:36.391833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:36.400289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:36.442267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 885/1781] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:36.446853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:36.462654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae76d7d-4998-4f8d-a404-d985fce019bf admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:36.507594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:36.509620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:36.510233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:36.510729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] PATH_INFO: `/v3/projects/24d52f68928a42c3b8a2e584b4b141ec/users/b6d5c9a001f042809bfeef52c8779bc7/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:36.570295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d52f68928a42c3b8a2e584b4b141ec, user_id=b6d5c9a001f042809bfeef52c8779bc7, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:36.577915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:36.632135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 897/1782] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:36 2022] PUT /identity/v3/projects/24d52f68928a42c3b8a2e584b4b141ec/users/b6d5c9a001f042809bfeef52c8779bc7/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:36.633903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:36.659912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c7773-ab8c-49e9-9fc7-46720f10786b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:36.858133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72146dae-e80e-4d92-a3f5-0563b1db90a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:36.860522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72146dae-e80e-4d92-a3f5-0563b1db90a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:36.861957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72146dae-e80e-4d92-a3f5-0563b1db90a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:36.862440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72146dae-e80e-4d92-a3f5-0563b1db90a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:36.863911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72146dae-e80e-4d92-a3f5-0563b1db90a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:36.869155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72146dae-e80e-4d92-a3f5-0563b1db90a2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:36.939282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:36.940115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 886/1783] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:36.956932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9348b4-0fdb-4b00-91d5-cfa2d6e2ba89 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:36.968953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:36.969941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:36.970214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:36.970481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] PATH_INFO: `/v3/projects/24d52f68928a42c3b8a2e584b4b141ec/users/b6d5c9a001f042809bfeef52c8779bc7/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:36.973348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d52f68928a42c3b8a2e584b4b141ec, user_id=b6d5c9a001f042809bfeef52c8779bc7, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:36.981037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:37.026970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 898/1784] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:36 2022] PUT /identity/v3/projects/24d52f68928a42c3b8a2e584b4b141ec/users/b6d5c9a001f042809bfeef52c8779bc7/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:37.032880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.033421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.033421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.080946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] MFA Rules not processed for user `b6d5c9a001f042809bfeef52c8779bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:37.083108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:37.144072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:37.146036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:37.237736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21443e0c-253c-4482-9ed1-779995af9d94 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:37.245152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:37.246273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.246549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.247437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] PATH_INFO: `/v3/projects/19d9de54e8704255822d7d78ba221f43` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.248266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d9de54e8704255822d7d78ba221f43)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:37.250321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:37.362397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 887/1785] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:37.378197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:37.380851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:37.406106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d9de54e8704255822d7d78ba221f43', 'request_id': 'req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:37.422760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d9de54e8704255822d7d78ba221f43', 'request_id': 'req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:37.455194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d9de54e8704255822d7d78ba221f43', 'request_id': 'req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:37.500386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] The token cache is being invalidate because project 19d9de54e8704255822d7d78ba221f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:37.500580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:37.507113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8138cc7d-ce30-49be-bb45-a14cdd87ebf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:37.516508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 899/1786] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:37 2022] DELETE /identity/v3/projects/19d9de54e8704255822d7d78ba221f43 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:37.519025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5a83-55f3-4318-9183-cc85aaa8489d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.523143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5a83-55f3-4318-9183-cc85aaa8489d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.523428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f5a83-55f3-4318-9183-cc85aaa8489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.573377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042be58-594c-4a36-b5dc-8ca0d75bb791 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:37.589767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-964f5a83-55f3-4318-9183-cc85aaa8489d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:37.593326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-964f5a83-55f3-4318-9183-cc85aaa8489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:37.714455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:37.715277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.715662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.716096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.722932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 900/1787] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:37.730177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:37.730332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.730739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.731213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.754387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:37.758357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:37.769992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 901/1788] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:37.774694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:37.800335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427be24-4385-47b8-a311-4f9bdf210ad3 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:37.806399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:37.807892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.808437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.808905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.809838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:37.810401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:37.813643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:37.835999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 902/1789] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:37.837536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:37.852939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc1338-8e63-4b27-8dbb-bc541a7c19c3 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:37.861566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:37.863370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:37.864216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:37.864687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:37.865771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:37.868094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:37.909521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 903/1790] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:37 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:37.911250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:37.917270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:37.920507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:37.937441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 888/1791] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:38.047197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72280f33-9f5b-4265-a22c-4fda8791ff63 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:38.068075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:38.068783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.069116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.069338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.070074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:38.077029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:38.106062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 904/1792] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:37 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:38.111395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:38.129198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd823164-fd9b-42c1-80c1-99a4a2a1138e service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:38.135071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:38.136303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.136303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.136485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.137327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:38.139080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:38.157974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 889/1793] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:38.160211 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:38.171138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d6d12-638d-48d6-9a2e-3872748213fb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:38.186253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214506b-8688-4b38-89f6-ccfaa82cc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:38.186981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214506b-8688-4b38-89f6-ccfaa82cc923 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.187421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214506b-8688-4b38-89f6-ccfaa82cc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.187535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214506b-8688-4b38-89f6-ccfaa82cc923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.188287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214506b-8688-4b38-89f6-ccfaa82cc923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:38.192450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214506b-8688-4b38-89f6-ccfaa82cc923 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:38.226911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:38.238362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 905/1794] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:38.248038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09b79a-c3b1-4586-9518-ae9c29c7757f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:38.264156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:38.265185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.265465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.265738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] PATH_INFO: `/v3/projects/ec46e219bc1c49b9b7544d657f4396a8/users/941ceb0d5a574f48a3c98a60589f48dd/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.299976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec46e219bc1c49b9b7544d657f4396a8, user_id=941ceb0d5a574f48a3c98a60589f48dd, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:38.310121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:38.347876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.347876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.347876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.348077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 890/1795] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:38 2022] PUT /identity/v3/projects/ec46e219bc1c49b9b7544d657f4396a8/users/941ceb0d5a574f48a3c98a60589f48dd/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:38.397382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] MFA Rules not processed for user `941ceb0d5a574f48a3c98a60589f48dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:38.398848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:38.520232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 906/1796] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:38.524574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:38.630069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5593e2-e342-419d-8cd3-77e4d556f8d6 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:38.637136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf427d-9c85-4ba8-8f80-6c137c536a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:38.637611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf427d-9c85-4ba8-8f80-6c137c536a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.639015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf427d-9c85-4ba8-8f80-6c137c536a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.639367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf427d-9c85-4ba8-8f80-6c137c536a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.640154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf427d-9c85-4ba8-8f80-6c137c536a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:38.643106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf427d-9c85-4ba8-8f80-6c137c536a1d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:38.690773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 891/1797] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:38 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:38.691230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:38.709781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8adeed-79c0-44d9-8520-70ff7b21e782 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:38.841108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7ea0-c1d0-470c-b6d8-10cf00be01b5 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.841462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7ea0-c1d0-470c-b6d8-10cf00be01b5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.841733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a7ea0-c1d0-470c-b6d8-10cf00be01b5 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.844346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 892/1798] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:16:38.859787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.860010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.860847 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.908596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:38.909885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:38.910040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:38.911376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:38.912705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:38.913157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:38.915152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:38.919915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:38.957507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 907/1799] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:38 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:38.972034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:38.996498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69c0fb-1348-42d5-a97c-1f7f774bd75f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:39.002125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:39.003033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.003384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.003719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.004524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:39.006299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:39.021314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 908/1800] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:39.023397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:39.035511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0f6f-68fc-4a5b-a2a9-7e24cca764c0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:39.042057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:39.043190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.043568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.044008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] PATH_INFO: `/v3/projects/e24a2a39e4b743ac867e105bf4684b45/users/1ffd60bdd39c49a2859f96f8e94635d4/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.049997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 893/1801] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:39.068049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:39.072522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:39.075466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24a2a39e4b743ac867e105bf4684b45, user_id=1ffd60bdd39c49a2859f96f8e94635d4, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:39.078715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:39.099849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 909/1802] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:39 2022] PUT /identity/v3/projects/e24a2a39e4b743ac867e105bf4684b45/users/1ffd60bdd39c49a2859f96f8e94635d4/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:39.104337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:39.104493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b9465-d299-45a6-886d-d180db6ecfb4 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:39.199054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:39.200403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.200713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.200986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.213518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:39.216173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:39.217253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23a963-31a1-4dd9-b1c9-d3c5afa49eeb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:39.223238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d76ea7-4881-44fb-be29-77bb29f58626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:39.224327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76ea7-4881-44fb-be29-77bb29f58626 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.224836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76ea7-4881-44fb-be29-77bb29f58626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.225351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76ea7-4881-44fb-be29-77bb29f58626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.226366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d76ea7-4881-44fb-be29-77bb29f58626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:39.228297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d76ea7-4881-44fb-be29-77bb29f58626 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:39.230077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 894/1803] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:39.245503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 910/1804] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:39.251291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:39.265154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a98f32-40e2-44a5-9c55-a811bb732ec4 service nova] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:39.270571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:39.275785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.277146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.277729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] PATH_INFO: `/v3/projects/e24a2a39e4b743ac867e105bf4684b45/users/1ffd60bdd39c49a2859f96f8e94635d4/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.281604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24a2a39e4b743ac867e105bf4684b45, user_id=1ffd60bdd39c49a2859f96f8e94635d4, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:39.285980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:39.303397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 895/1805] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:39 2022] PUT /identity/v3/projects/e24a2a39e4b743ac867e105bf4684b45/users/1ffd60bdd39c49a2859f96f8e94635d4/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:39.315230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.315512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.315802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.348095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] MFA Rules not processed for user `1ffd60bdd39c49a2859f96f8e94635d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:39.350087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:39.526634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 911/1806] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:39.533281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:39.537237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:39.679065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c55e4-c646-4902-9c90-0443b71c9b9c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:39.714582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:39.714582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:39.715537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:39.715874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:39.743501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:39.748014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:39.786708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 896/1807] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:40.318474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:40.327835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bf1e5-a41a-4946-834c-732334eb53ad None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:40.333621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ffd60bdd39c49a2859f96f8e94635d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e24a2a39e4b743ac867e105bf4684b45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:40.334460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:40.334840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:40.335279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:40.336119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:40.336531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:40.338396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:40.354926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 912/1808] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:40.357846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:40.368134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80c7e8-7d48-4e78-8cbd-90543a9d33fd service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:40.375592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ffd60bdd39c49a2859f96f8e94635d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e24a2a39e4b743ac867e105bf4684b45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:40.377084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:40.377434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:40.377709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:40.378463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:40.381152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:40.427975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 897/1809] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:40 2022] POST /identity/v3/projects => generated 354 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:40.433279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:40.443506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ea2be-d701-499f-919f-400c9f251b14 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:40.503935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ffd60bdd39c49a2859f96f8e94635d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e24a2a39e4b743ac867e105bf4684b45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:40.504534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:40.504818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:40.505117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:40.505838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:40.506141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:40.507792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:40.523490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 913/1810] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:40.561478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:40.574286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ead48-5a61-4ed0-923e-b75f1ad05d8a tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:40.580082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ffd60bdd39c49a2859f96f8e94635d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e24a2a39e4b743ac867e105bf4684b45', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:40.580979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:40.581256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:40.581524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] PATH_INFO: `/v3/projects/af58a91611e4404d93ced064c3a0d650` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:40.582829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af58a91611e4404d93ced064c3a0d650)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:40.584804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:40.642762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af58a91611e4404d93ced064c3a0d650', 'request_id': 'req-fe1a185b-7758-45f4-add7-747118c86c91'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:40.653072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af58a91611e4404d93ced064c3a0d650', 'request_id': 'req-fe1a185b-7758-45f4-add7-747118c86c91'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:40.661700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af58a91611e4404d93ced064c3a0d650', 'request_id': 'req-fe1a185b-7758-45f4-add7-747118c86c91'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:40.671682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] The token cache is being invalidate because project af58a91611e4404d93ced064c3a0d650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:40.671965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:40.672673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fe1a185b-7758-45f4-add7-747118c86c91 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:40.674285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 898/1811] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:40 2022] DELETE /identity/v3/projects/af58a91611e4404d93ced064c3a0d650 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:40.882719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:40.884430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:40.948340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a72b5-78a8-4a83-b031-54d612d341f1 tempest-VolumeQuotaClassesTest-1053831761 tempest-VolumeQuotaClassesTest-1053831761-project-admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:41.015636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:41.016596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.016871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.017138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] PATH_INFO: `/v3/users/941ceb0d5a574f48a3c98a60589f48dd` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.018375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941ceb0d5a574f48a3c98a60589f48dd)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:41.020392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:41.105468 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941ceb0d5a574f48a3c98a60589f48dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.114799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941ceb0d5a574f48a3c98a60589f48dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.127723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941ceb0d5a574f48a3c98a60589f48dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.128541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941ceb0d5a574f48a3c98a60589f48dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.129243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941ceb0d5a574f48a3c98a60589f48dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.156420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 914/1812] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:40 2022] DELETE /identity/v3/users/941ceb0d5a574f48a3c98a60589f48dd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:41.158017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55625bc-e966-43a7-a60c-a967cbe59036 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.158302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55625bc-e966-43a7-a60c-a967cbe59036 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.158621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55625bc-e966-43a7-a60c-a967cbe59036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.187663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f55625bc-e966-43a7-a60c-a967cbe59036 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:41.188757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f55625bc-e966-43a7-a60c-a967cbe59036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:41.268012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 899/1813] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:41.279394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:41.280742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:41.369149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec80f42-e1ea-4780-b3b1-74a32f19df47 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:41.376376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb27dd-2cf6-4cb8-a6e8-b43c104f5f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:41.377040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb27dd-2cf6-4cb8-a6e8-b43c104f5f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.377321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb27dd-2cf6-4cb8-a6e8-b43c104f5f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.377595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb27dd-2cf6-4cb8-a6e8-b43c104f5f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.392153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb27dd-2cf6-4cb8-a6e8-b43c104f5f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:41.393665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb27dd-2cf6-4cb8-a6e8-b43c104f5f4a service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:41.410407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 915/1814] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:41.615288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62a4a-fc77-480a-b3c2-ed941afb4b81 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.616973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62a4a-fc77-480a-b3c2-ed941afb4b81 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.617813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62a4a-fc77-480a-b3c2-ed941afb4b81 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.619661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 900/1815] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:16:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:16:41.633682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.634327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.634812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.672652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:41.675032 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:41.762455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec62a4a-fc77-480a-b3c2-ed941afb4b81 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:41.764434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5ec62a4a-fc77-480a-b3c2-ed941afb4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:41.796742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 916/1816] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:41.800766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec62a4a-fc77-480a-b3c2-ed941afb4b81 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:41.811213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:41.812016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.812298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.813248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] PATH_INFO: `/v3/projects/ec46e219bc1c49b9b7544d657f4396a8` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.814636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec46e219bc1c49b9b7544d657f4396a8)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:41.816871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:41.820090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:41.821674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:41.835943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ede68-1796-46e0-8584-e88307413ec9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:41.843584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:41.844283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:41.844566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:41.845112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:41.857869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:41.860020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:41.874907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 917/1817] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:41.884829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec46e219bc1c49b9b7544d657f4396a8', 'request_id': 'req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.895150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec46e219bc1c49b9b7544d657f4396a8', 'request_id': 'req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.903856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec46e219bc1c49b9b7544d657f4396a8', 'request_id': 'req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.914192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] The token cache is being invalidate because project ec46e219bc1c49b9b7544d657f4396a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:41.914480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.915156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:41.916773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 901/1818] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:41 2022] DELETE /identity/v3/projects/ec46e219bc1c49b9b7544d657f4396a8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:41.920728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:41.932168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316dcfa-b32d-434e-bc76-ecf050ed48c5 service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:41.999270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.000257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.000629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.000987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] PATH_INFO: `/v3/users/1ffd60bdd39c49a2859f96f8e94635d4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.002614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffd60bdd39c49a2859f96f8e94635d4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.004969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.057124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffd60bdd39c49a2859f96f8e94635d4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.065863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffd60bdd39c49a2859f96f8e94635d4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.073912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffd60bdd39c49a2859f96f8e94635d4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.074599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffd60bdd39c49a2859f96f8e94635d4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.075251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9df789cb-5842-4d1a-8a89-a3b55c06834e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffd60bdd39c49a2859f96f8e94635d4'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.092569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 918/1819] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:41 2022] DELETE /identity/v3/users/1ffd60bdd39c49a2859f96f8e94635d4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:42.362573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.365253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:42.388750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0f6e1-c3ae-4575-bd8f-80f9b8ac04f8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.463664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.464603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.464884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.465157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] PATH_INFO: `/v3/projects/e24a2a39e4b743ac867e105bf4684b45` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.466384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24a2a39e4b743ac867e105bf4684b45)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.468387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.519548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24a2a39e4b743ac867e105bf4684b45', 'request_id': 'req-34e35b8d-654a-4e1a-876a-41f3cc931ef0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.525854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24a2a39e4b743ac867e105bf4684b45', 'request_id': 'req-34e35b8d-654a-4e1a-876a-41f3cc931ef0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.535439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24a2a39e4b743ac867e105bf4684b45', 'request_id': 'req-34e35b8d-654a-4e1a-876a-41f3cc931ef0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.548786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] The token cache is being invalidate because project e24a2a39e4b743ac867e105bf4684b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:42.549081 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.549727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-34e35b8d-654a-4e1a-876a-41f3cc931ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:42.555440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 902/1820] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:42 2022] DELETE /identity/v3/projects/e24a2a39e4b743ac867e105bf4684b45 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:42.557495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.557952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.558346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.583826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:42.585280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:42.659043 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 919/1821] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:42.664676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.665181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.665268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.685603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:42.686909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:42.696401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 903/1822] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:42.700993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.714404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01ed25-4b7e-4034-b808-652de6c7a6d8 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.722690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.723099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.723380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.723781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.725298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:42.725298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.726694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.744865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 920/1823] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:42.746030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.755547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efda831-d7a6-4979-b5a8-481a21bca3f5 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.764254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.764254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.764254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.765672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.766459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.768491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.806767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 904/1824] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:42 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:42.810970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.820985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2638-4fe7-4b68-9b42-9f8e26a29a46 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.886672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.887942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.888432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.888911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.890052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.892379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.915025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.917642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:42.920473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 921/1825] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:42 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:42.921618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.932802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2cb5c-58cf-4eed-a5d5-43acde629c1a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.937736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.938400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.938680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.938997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.939721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.941541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.953214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 922/1826] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:42.956884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:42.969164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af63ff0-537c-4c93-a212-210bc808858b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.975777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.976479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.977025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.977025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.977750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:42.979410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:42.987144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7df8fd-6f04-4dfb-a7bd-e43b40d1e52d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:42.991653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:42.992521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:42.996056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:42.996056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:42.996254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 923/1827] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:16:42.996358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:42.997199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.007284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4346-9026-4da6-8149-530cf005642f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.011956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d0f6b-03c8-43fd-a2bf-0282da42a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.012963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0f6b-03c8-43fd-a2bf-0282da42a8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.013512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0f6b-03c8-43fd-a2bf-0282da42a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.013512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0f6b-03c8-43fd-a2bf-0282da42a8ff admin admin] PATH_INFO: `/v3/projects/960982ba63ba43a4af10ad2564ca7b91/users/62e51b5348604edc9b16bd416b8c66dd/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.034460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0f6b-03c8-43fd-a2bf-0282da42a8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=960982ba63ba43a4af10ad2564ca7b91, user_id=62e51b5348604edc9b16bd416b8c66dd, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.039265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0f6b-03c8-43fd-a2bf-0282da42a8ff admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.071017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 924/1828] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:42 2022] PUT /identity/v3/projects/960982ba63ba43a4af10ad2564ca7b91/users/62e51b5348604edc9b16bd416b8c66dd/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:43.078762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.079082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.079354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.082626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.084267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.095371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 905/1829] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:43.106604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] MFA Rules not processed for user `62e51b5348604edc9b16bd416b8c66dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:43.107855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:43.174682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 925/1830] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:43.179543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.192957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd2a42-4996-4c5c-bda2-6506a0751a5d service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.249566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.250240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.250518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.250790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.251507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.253749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.288067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 906/1831] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:43 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:43.291778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.309407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf51fb-9c38-480e-ab6d-e0f4e2267366 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.383844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.385220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.385699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.386180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.388118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.391269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.416628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 926/1832] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:43 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:43.420786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.433938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667de0d-ca87-4c6a-bdcb-efa3c79588c4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.440201 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.440972 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.441310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.441655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.442741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.444622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.464202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 907/1833] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:43.465172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.475703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988e7f7-0be3-4ad8-882c-1c05edde22b9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.480930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.481886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.482166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.482438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] PATH_INFO: `/v3/projects/5e6b4e29f649417bade87570fb0db1a6/users/4105ec8affb54dcea8edfd4d6ae3ee52/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.504193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6b4e29f649417bade87570fb0db1a6, user_id=4105ec8affb54dcea8edfd4d6ae3ee52, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.508275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.538469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 927/1834] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:43 2022] PUT /identity/v3/projects/5e6b4e29f649417bade87570fb0db1a6/users/4105ec8affb54dcea8edfd4d6ae3ee52/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:43.542874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.555999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae862e4f-4cfd-485e-995c-4b737431b316 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.689367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356e9d8-a8b6-4b64-8408-9bda56e2b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.690046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356e9d8-a8b6-4b64-8408-9bda56e2b3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.690665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356e9d8-a8b6-4b64-8408-9bda56e2b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.692007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356e9d8-a8b6-4b64-8408-9bda56e2b3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.692674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356e9d8-a8b6-4b64-8408-9bda56e2b3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.694283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356e9d8-a8b6-4b64-8408-9bda56e2b3cf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.710793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:43.718631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 908/1835] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:43.722523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df6be2-7c63-4810-b55a-9e331d1765b7 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:43.727670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:43.728661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.728959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.729209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] PATH_INFO: `/v3/projects/5e6b4e29f649417bade87570fb0db1a6/users/4105ec8affb54dcea8edfd4d6ae3ee52/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.731338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6b4e29f649417bade87570fb0db1a6, user_id=4105ec8affb54dcea8edfd4d6ae3ee52, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:43.734617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:43.756415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 928/1836] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:43 2022] PUT /identity/v3/projects/5e6b4e29f649417bade87570fb0db1a6/users/4105ec8affb54dcea8edfd4d6ae3ee52/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:43.768055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:43.769570 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:43.769991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:43.854412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] MFA Rules not processed for user `4105ec8affb54dcea8edfd4d6ae3ee52`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:43.855934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:43.959180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 909/1837] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:43.970830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:44.051218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e582-1546-4b6f-aaa1-4b893db83e0f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:44.057004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:44.058572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:44.059117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:44.059625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:44.081233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:44.082813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:44.105710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 929/1838] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:44.270851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:44.292623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e877a-c844-464a-b2fa-476f456f1eee None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:44.297525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7534c8-8fe8-4600-a4bc-ef2f829713f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:44.298179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7534c8-8fe8-4600-a4bc-ef2f829713f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:44.298450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7534c8-8fe8-4600-a4bc-ef2f829713f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:44.298715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7534c8-8fe8-4600-a4bc-ef2f829713f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:44.377974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7534c8-8fe8-4600-a4bc-ef2f829713f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:44.379640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7534c8-8fe8-4600-a4bc-ef2f829713f3 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:44.411317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 910/1839] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:48.316365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:48.381870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ffced-9099-426f-affd-f8323d513121 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:48.391627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:48.392528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:48.392819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:48.393085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] PATH_INFO: `/v3/users/62e51b5348604edc9b16bd416b8c66dd` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:48.394369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e51b5348604edc9b16bd416b8c66dd)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:48.396398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:48.451083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e51b5348604edc9b16bd416b8c66dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:48.470393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e51b5348604edc9b16bd416b8c66dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:48.480505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e51b5348604edc9b16bd416b8c66dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:48.481533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e51b5348604edc9b16bd416b8c66dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:48.482391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e51b5348604edc9b16bd416b8c66dd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:48.506132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 930/1840] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:48 2022] DELETE /identity/v3/users/62e51b5348604edc9b16bd416b8c66dd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:48.510607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:48.511134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:48.511295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:48.540578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:48.542109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:48.641431 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 911/1841] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:48.655357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:48.656812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:48.760939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c4ce8-9535-4e4e-9dcf-0a79bf197228 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:48.770094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:48.770094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:48.770094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:48.770094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:48.781407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:48.783462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:48.794993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 931/1842] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:49.335130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:49.336586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:49.351233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867b0c5-274c-4cc5-9a8f-26b6476e13d9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:49.356983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:49.357723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:49.358129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:49.358296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] PATH_INFO: `/v3/projects/960982ba63ba43a4af10ad2564ca7b91` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:49.359599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960982ba63ba43a4af10ad2564ca7b91)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:49.361464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:49.409199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960982ba63ba43a4af10ad2564ca7b91', 'request_id': 'req-43c8436d-7291-42c2-8efc-4e099089a1c7'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.416949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960982ba63ba43a4af10ad2564ca7b91', 'request_id': 'req-43c8436d-7291-42c2-8efc-4e099089a1c7'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.426938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960982ba63ba43a4af10ad2564ca7b91', 'request_id': 'req-43c8436d-7291-42c2-8efc-4e099089a1c7'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.439974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] The token cache is being invalidate because project 960982ba63ba43a4af10ad2564ca7b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:49.440396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.441151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.443668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 912/1843] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:49 2022] DELETE /identity/v3/projects/960982ba63ba43a4af10ad2564ca7b91 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:49.447456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:49.460102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacde92-7671-4d9d-a21c-b0f2268bb6fb service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:49.521851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:49.522911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:49.523231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:49.523501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] PATH_INFO: `/v3/users/4105ec8affb54dcea8edfd4d6ae3ee52` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:49.524845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4105ec8affb54dcea8edfd4d6ae3ee52)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:49.526770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:49.580499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4105ec8affb54dcea8edfd4d6ae3ee52'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.588438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4105ec8affb54dcea8edfd4d6ae3ee52'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.598639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4105ec8affb54dcea8edfd4d6ae3ee52'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.599377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4105ec8affb54dcea8edfd4d6ae3ee52'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.601626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-62d44b9a-fa31-47ee-9048-2cfdc9b95deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4105ec8affb54dcea8edfd4d6ae3ee52'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:49.621364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 932/1844] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:49 2022] DELETE /identity/v3/users/4105ec8affb54dcea8edfd4d6ae3ee52 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:50.013100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.015416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:50.029345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8436d-7291-42c2-8efc-4e099089a1c7 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.087261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.088193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.088474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.088746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] PATH_INFO: `/v3/projects/5e6b4e29f649417bade87570fb0db1a6` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.089921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6b4e29f649417bade87570fb0db1a6)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.091862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.137792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6b4e29f649417bade87570fb0db1a6', 'request_id': 'req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:50.143902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6b4e29f649417bade87570fb0db1a6', 'request_id': 'req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:50.153272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6b4e29f649417bade87570fb0db1a6', 'request_id': 'req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:50.164765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] The token cache is being invalidate because project 5e6b4e29f649417bade87570fb0db1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:50.165050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:50.165700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-16b7d19d-a453-4a09-9c8e-85c0a1b0fda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:50.167472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 913/1845] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:50 2022] DELETE /identity/v3/projects/5e6b4e29f649417bade87570fb0db1a6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:50.172404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.172719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.172988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.191754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:50.192947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:50.256798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 933/1846] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:50.262603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.263077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.263502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.285742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:50.287077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:50.297146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 914/1847] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:50.301901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.312898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ad08b-cc2a-4cc0-a983-d3a469b8d834 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.317514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.318152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.318425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.318691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.319485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:50.319785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.321390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.332620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 934/1848] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:50.337133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.346721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1b2a7-85bd-4eb2-b812-e230d193a3bf None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.352474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.353137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.353421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.353692 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.354387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.356340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.387660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 915/1849] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:50.387851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.399531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8c3eb-0193-4a48-9304-d40d2a3cc5c8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.456080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.456732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.457074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.457361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.458030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.460017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.486013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 935/1850] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:50.487225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.498609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803be9-25f9-4362-8cf1-1e0d3020a0f2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.503634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.504377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.504702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.504970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.505845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.507505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.517962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 916/1851] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:50.522106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.532055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561237-c141-4c2e-aa1a-d320a7c70772 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.537071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974a0f-26f1-4552-95dd-52349ebaa75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.537738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974a0f-26f1-4552-95dd-52349ebaa75e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.538019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974a0f-26f1-4552-95dd-52349ebaa75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.538292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974a0f-26f1-4552-95dd-52349ebaa75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.539051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0974a0f-26f1-4552-95dd-52349ebaa75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.540657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0974a0f-26f1-4552-95dd-52349ebaa75e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.551192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 936/1852] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:50.555414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.565456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517660-2482-4714-92b9-62a8df6a38a8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.570110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.571096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.571294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.571565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] PATH_INFO: `/v3/projects/3d49b28a195545af83f8814157d8422f/users/af97ac44a1bf4283a89c03e5c657c097/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.585899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d49b28a195545af83f8814157d8422f, user_id=af97ac44a1bf4283a89c03e5c657c097, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.588669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.614039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 917/1853] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:50 2022] PUT /identity/v3/projects/3d49b28a195545af83f8814157d8422f/users/af97ac44a1bf4283a89c03e5c657c097/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:50.616171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.616463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.616739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.644404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] MFA Rules not processed for user `af97ac44a1bf4283a89c03e5c657c097`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:50.645626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:50.715709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 937/1854] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:50.720374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.779061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6024-5fe6-4645-8c66-77348ba99a0e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.784395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.785047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.785322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.785561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.786277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.788200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.816186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 918/1855] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:50.820128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.834138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d4c53-a144-44cf-ac62-c2114cf8a375 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.899614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.900292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.900572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.900841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.901531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.903641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.922949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 938/1856] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:50 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:50.927121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.938077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b340-d754-4287-86f9-c8b52fcded21 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.943448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.944105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.944375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.944644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.945382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.946995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:50.958807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 919/1857] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:16:50.962862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:50.973189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f68b5-b2c5-4a4a-aede-53bfb2ed9071 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:50.978031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:50.979031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:50.979294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:50.979577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] PATH_INFO: `/v3/projects/dda7dda2d02d4781b23488862cd0a2cc/users/a913cb2b4da546969e0cc0b28653fc12/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:50.994276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda7dda2d02d4781b23488862cd0a2cc, user_id=a913cb2b4da546969e0cc0b28653fc12, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:50.997012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:51.011857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 939/1858] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:50 2022] PUT /identity/v3/projects/dda7dda2d02d4781b23488862cd0a2cc/users/a913cb2b4da546969e0cc0b28653fc12/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:51.015635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:51.025842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096826b-2312-46b5-9811-d63fdce16ff1 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:51.081333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58af08-b890-432b-a8de-509618d03979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:51.082009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58af08-b890-432b-a8de-509618d03979 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:51.082288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58af08-b890-432b-a8de-509618d03979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:51.082577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58af08-b890-432b-a8de-509618d03979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:51.083366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58af08-b890-432b-a8de-509618d03979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:51.084964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58af08-b890-432b-a8de-509618d03979 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:51.098132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 920/1859] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:51.099380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:51.109375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cafd3-08de-4779-8ffb-b0b1741897d2 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:51.113989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:51.114891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:51.115182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:51.115452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] PATH_INFO: `/v3/projects/dda7dda2d02d4781b23488862cd0a2cc/users/a913cb2b4da546969e0cc0b28653fc12/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:51.117417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda7dda2d02d4781b23488862cd0a2cc, user_id=a913cb2b4da546969e0cc0b28653fc12, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:51.120173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:51.131652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 940/1860] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:51 2022] PUT /identity/v3/projects/dda7dda2d02d4781b23488862cd0a2cc/users/a913cb2b4da546969e0cc0b28653fc12/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:16:51.141965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:51.142252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:51.142526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:51.170116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] MFA Rules not processed for user `a913cb2b4da546969e0cc0b28653fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:51.171340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:51.240414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 921/1861] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:51.251469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:51.253386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:51.314579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741be91-6470-4748-8d3e-8f53561fae71 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:51.318316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b8ce3-0af3-4018-84d5-b9edfe6f946c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:51.319102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b8ce3-0af3-4018-84d5-b9edfe6f946c service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:51.319385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b8ce3-0af3-4018-84d5-b9edfe6f946c service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:51.319726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b8ce3-0af3-4018-84d5-b9edfe6f946c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:51.329774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b8ce3-0af3-4018-84d5-b9edfe6f946c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:51.331194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b8ce3-0af3-4018-84d5-b9edfe6f946c service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:51.341142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 941/1862] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:16:51.875753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:51.939317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270541d-3c4c-4791-a7e6-deddcb9138c0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:51.944020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:51.944886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:51.945166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:51.945440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] PATH_INFO: `/v3/users/af97ac44a1bf4283a89c03e5c657c097` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:51.946654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af97ac44a1bf4283a89c03e5c657c097)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:51.948645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:51.995817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af97ac44a1bf4283a89c03e5c657c097'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.005610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af97ac44a1bf4283a89c03e5c657c097'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.014449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af97ac44a1bf4283a89c03e5c657c097'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.015401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af97ac44a1bf4283a89c03e5c657c097'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.027737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af97ac44a1bf4283a89c03e5c657c097'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.034547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 922/1863] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:51 2022] DELETE /identity/v3/users/af97ac44a1bf4283a89c03e5c657c097 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:52.039137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:52.039577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:52.039770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:52.057824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:52.059661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:52.117617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 942/1864] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:52.127524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:52.128950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:52.189739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ea42-579f-4b1e-8c70-68ae5e022fd0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:52.193691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:52.194464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:52.194746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:52.195046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:52.204714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:52.206199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:52.215730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 923/1865] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:52.502544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:52.504119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:52.516808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7f05-ee79-4738-8d41-6311f229b7a0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:52.530303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:52.531421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:52.531898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:52.532291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] PATH_INFO: `/v3/projects/3d49b28a195545af83f8814157d8422f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:52.534283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d49b28a195545af83f8814157d8422f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:52.536428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:52.585904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d49b28a195545af83f8814157d8422f', 'request_id': 'req-4e525f9f-df50-417f-bf73-44e419e527ec'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.594270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d49b28a195545af83f8814157d8422f', 'request_id': 'req-4e525f9f-df50-417f-bf73-44e419e527ec'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.600294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d49b28a195545af83f8814157d8422f', 'request_id': 'req-4e525f9f-df50-417f-bf73-44e419e527ec'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.611202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] The token cache is being invalidate because project 3d49b28a195545af83f8814157d8422f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:52.611494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.612138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.613847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 943/1866] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:52 2022] DELETE /identity/v3/projects/3d49b28a195545af83f8814157d8422f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:52.618003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:52.627990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907a3f7-cf5a-43a6-a451-a615474edf7c service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:52.684016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:52.684873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:52.685150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:52.685423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] PATH_INFO: `/v3/users/a913cb2b4da546969e0cc0b28653fc12` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:52.686601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a913cb2b4da546969e0cc0b28653fc12)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:52.688564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:52.737590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a913cb2b4da546969e0cc0b28653fc12'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.745838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a913cb2b4da546969e0cc0b28653fc12'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.753152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a913cb2b4da546969e0cc0b28653fc12'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.753773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a913cb2b4da546969e0cc0b28653fc12'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.765228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba3e9cda-2718-4702-9db8-bdfcd350a981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a913cb2b4da546969e0cc0b28653fc12'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:52.771424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 924/1867] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:16:52 2022] DELETE /identity/v3/users/a913cb2b4da546969e0cc0b28653fc12 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:53.051047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.053012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:53.068054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e525f9f-df50-417f-bf73-44e419e527ec admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.124245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.125105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.125378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.125643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] PATH_INFO: `/v3/projects/dda7dda2d02d4781b23488862cd0a2cc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.126813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda7dda2d02d4781b23488862cd0a2cc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.128746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.185080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda7dda2d02d4781b23488862cd0a2cc', 'request_id': 'req-9742032d-afd5-491e-ae30-244a897ae962'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:53.195980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda7dda2d02d4781b23488862cd0a2cc', 'request_id': 'req-9742032d-afd5-491e-ae30-244a897ae962'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:53.203003 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda7dda2d02d4781b23488862cd0a2cc', 'request_id': 'req-9742032d-afd5-491e-ae30-244a897ae962'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:53.213976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] The token cache is being invalidate because project dda7dda2d02d4781b23488862cd0a2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:16:53.214274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:53.214968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-9742032d-afd5-491e-ae30-244a897ae962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:16:53.217010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 944/1868] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:16:53 2022] DELETE /identity/v3/projects/dda7dda2d02d4781b23488862cd0a2cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:53.222943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.223438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.223607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.241985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:53.243262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:53.304476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 925/1869] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:53.314161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.314515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.314787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.335721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:53.336933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:53.350960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 945/1870] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:53.351129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.362258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dfdd6-2b4d-4e66-94dc-adc9840099ac None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.367780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.369473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.369909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.370349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.371276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:16:53.371578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.373453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.408999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 926/1871] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:16:53.413963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.433554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964577f-9bcf-4eee-b026-ccfc5929d3ab None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.450544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.451218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.451780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.452058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.452850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.454868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.513317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 946/1872] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:53 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:53.517626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.533360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7765a-5e09-404b-9ac5-91e769fdef81 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.610853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.612293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.612593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.615261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.616555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.618840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.650734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 927/1873] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:53 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:16:53.654675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.667571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998ce2d-209d-4e52-b507-6ba658e0e2d7 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.692230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.693198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.693680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.700900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.701918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.703703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.721838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 947/1874] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:16:53.726077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.739508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7967c6-1fff-48b1-93a7-b1af38260673 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.746480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5436939-d1d0-4216-8fe9-4f39bbf5e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.747957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436939-d1d0-4216-8fe9-4f39bbf5e83e admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.747957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436939-d1d0-4216-8fe9-4f39bbf5e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.748263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5436939-d1d0-4216-8fe9-4f39bbf5e83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.749139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5436939-d1d0-4216-8fe9-4f39bbf5e83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.750834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5436939-d1d0-4216-8fe9-4f39bbf5e83e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.767122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 928/1875] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:16:53.771438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.785579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919773f-c9c3-421e-9a42-f1cb0dc74ecc admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.790679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.792291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.792291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.792291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] PATH_INFO: `/v3/projects/74c56bb918414ffe937415b180eb5944/users/599e6fd88ed348eab5de9a6330daf477/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.811610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c56bb918414ffe937415b180eb5944, user_id=599e6fd88ed348eab5de9a6330daf477, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:53.814500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:53.833206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 948/1876] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:53 2022] PUT /identity/v3/projects/74c56bb918414ffe937415b180eb5944/users/599e6fd88ed348eab5de9a6330daf477/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:53.838397 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab924c-ad44-4a64-a8c1-f4e144098130 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.838685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab924c-ad44-4a64-a8c1-f4e144098130 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.839040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab924c-ad44-4a64-a8c1-f4e144098130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:53.858277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-76ab924c-ad44-4a64-a8c1-f4e144098130 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:53.860013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-76ab924c-ad44-4a64-a8c1-f4e144098130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:53.921201 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 929/1877] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:16:53.930787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:53.932965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:53.987446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dbf9b-3da8-41c7-9ad8-8ba50a36fe60 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:53.991462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:53.992109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:53.992382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:53.992646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:54.003799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:54.005258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:54.014871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 949/1878] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:16:59.496615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:59.497075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:59.497945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:59.527470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] MFA Rules not processed for user `599e6fd88ed348eab5de9a6330daf477`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:16:59.529188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:16:59.599102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 930/1879] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:16:59.603289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:59.613278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36177d-90e0-4ec7-90e4-77d9493e8c60 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:59.623960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:59.624714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:59.624990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:59.625258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:59.625958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:59.627934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:59.668299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 950/1880] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:16:59 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:59.673814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:59.687951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8899f9-0990-4b67-ad38-f50bea9d9a28 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:59.746153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:59.747017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:59.747300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:59.747574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:59.748291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:59.750192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:59.770592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 931/1881] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:16:59 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:16:59.774536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:59.784455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c957b-ee47-4dc5-af71-15b415897a37 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:59.790755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:59.791530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:59.791805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:59.792071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:59.792794 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:59.794420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:59.806976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 951/1882] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:59.816126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:59.831976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78479c51-72a8-45ec-a873-91ad96fdf733 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:59.845725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:59.846747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:59.847176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:59.847651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] PATH_INFO: `/v3/projects/f421c214c71643719681d41d51ce25fa/users/7a4b24b5fd3e4d0cb65aede1c52aa374/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:59.873643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f421c214c71643719681d41d51ce25fa, user_id=7a4b24b5fd3e4d0cb65aede1c52aa374, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:59.876351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:59.895317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 932/1883] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:59 2022] PUT /identity/v3/projects/f421c214c71643719681d41d51ce25fa/users/7a4b24b5fd3e4d0cb65aede1c52aa374/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:16:59.900479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:16:59.911242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b38d0-e6e5-44be-9ff7-8103638fde43 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:16:59.973088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b544b6-4e8d-4e39-a61b-1c47ff1633e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:16:59.973778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b544b6-4e8d-4e39-a61b-1c47ff1633e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:16:59.974058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b544b6-4e8d-4e39-a61b-1c47ff1633e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:16:59.974328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b544b6-4e8d-4e39-a61b-1c47ff1633e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:16:59.975234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b544b6-4e8d-4e39-a61b-1c47ff1633e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:16:59.978991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b544b6-4e8d-4e39-a61b-1c47ff1633e2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:16:59.993720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 952/1884] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:16:59.994596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:00.007374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858ec20-da08-4ab3-9c11-158d61974226 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:00.013810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:00.014710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:00.015029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:00.015927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] PATH_INFO: `/v3/projects/f421c214c71643719681d41d51ce25fa/users/7a4b24b5fd3e4d0cb65aede1c52aa374/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:00.017916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f421c214c71643719681d41d51ce25fa, user_id=7a4b24b5fd3e4d0cb65aede1c52aa374, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:00.020609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:00.031492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 933/1885] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:16:59 2022] PUT /identity/v3/projects/f421c214c71643719681d41d51ce25fa/users/7a4b24b5fd3e4d0cb65aede1c52aa374/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:05.643695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:05.644272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:05.644272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:05.674081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] MFA Rules not processed for user `7a4b24b5fd3e4d0cb65aede1c52aa374`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:05.675341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:05.758951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 953/1886] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:05.771981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:05.774045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:05.866694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc36f54-5c55-4e9e-a046-8d5431976071 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:05.873623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005952e9-4dd8-4c99-a19b-235a7c96c97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:05.875073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005952e9-4dd8-4c99-a19b-235a7c96c97a service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:05.875365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005952e9-4dd8-4c99-a19b-235a7c96c97a service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:05.876442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005952e9-4dd8-4c99-a19b-235a7c96c97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:05.934614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005952e9-4dd8-4c99-a19b-235a7c96c97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:05.936622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005952e9-4dd8-4c99-a19b-235a7c96c97a service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:05.947156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 934/1887] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:13.240816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:13.243098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:13.334753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84635-0b79-431d-9760-23bd3b0ef177 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:13.343779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:13.344694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:13.344973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:13.345248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] PATH_INFO: `/v3/users/3280f94980364753b4cf275dd83fafe2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:13.350920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3280f94980364753b4cf275dd83fafe2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:13.354663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:13.444553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3280f94980364753b4cf275dd83fafe2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:13.461156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3280f94980364753b4cf275dd83fafe2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:13.484729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3280f94980364753b4cf275dd83fafe2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:13.486288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3280f94980364753b4cf275dd83fafe2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:13.488173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3280f94980364753b4cf275dd83fafe2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:13.516698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 954/1888] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:13 2022] DELETE /identity/v3/users/3280f94980364753b4cf275dd83fafe2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:13.523829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:13.524363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:13.524591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:13.546832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:13.548313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:13.625197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 935/1889] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:13.636994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:13.638617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:13.708827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da9dab-3e0e-4be8-8bea-26b27ee23937 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:13.713630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:13.714773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:13.715137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:13.715822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:13.726631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:13.728197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:13.738605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 955/1890] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:14.278868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:14.280584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:14.297959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2348efa-a8c8-4ec7-92d2-17e24a05acad None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:14.318268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:14.319205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:14.319483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:14.319757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] PATH_INFO: `/v3/projects/ea68d3c351b54ec0a7f40271756914ad` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:14.322166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea68d3c351b54ec0a7f40271756914ad)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:14.324137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:14.377727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea68d3c351b54ec0a7f40271756914ad', 'request_id': 'req-1bfe064a-657b-4252-a53c-c75b682b842a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.384432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea68d3c351b54ec0a7f40271756914ad', 'request_id': 'req-1bfe064a-657b-4252-a53c-c75b682b842a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.394159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea68d3c351b54ec0a7f40271756914ad', 'request_id': 'req-1bfe064a-657b-4252-a53c-c75b682b842a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.405775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] The token cache is being invalidate because project ea68d3c351b54ec0a7f40271756914ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:14.406070 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.406739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.409031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 936/1891] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:14 2022] DELETE /identity/v3/projects/ea68d3c351b54ec0a7f40271756914ad => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:14.412781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:14.422972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b312bb-9294-4e8d-a8d3-b048bac55b2e service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:14.483757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:14.484642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:14.484916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:14.485184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] PATH_INFO: `/v3/users/b6d5c9a001f042809bfeef52c8779bc7` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:14.486352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d5c9a001f042809bfeef52c8779bc7)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:14.488302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:14.556572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d5c9a001f042809bfeef52c8779bc7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.585635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d5c9a001f042809bfeef52c8779bc7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.600299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d5c9a001f042809bfeef52c8779bc7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.601286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d5c9a001f042809bfeef52c8779bc7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.602030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-2c79c50e-009e-4326-b148-c77170c12bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d5c9a001f042809bfeef52c8779bc7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:14.629633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 956/1892] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:14 2022] DELETE /identity/v3/users/b6d5c9a001f042809bfeef52c8779bc7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:17:15.220269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.221822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:15.235049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe064a-657b-4252-a53c-c75b682b842a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.323773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.324734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.326277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.326277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] PATH_INFO: `/v3/projects/24d52f68928a42c3b8a2e584b4b141ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.327029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d52f68928a42c3b8a2e584b4b141ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.329006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.376808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d52f68928a42c3b8a2e584b4b141ec', 'request_id': 'req-d1a592d5-b15a-4eb5-94c8-8480efeba70d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:15.383167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d52f68928a42c3b8a2e584b4b141ec', 'request_id': 'req-d1a592d5-b15a-4eb5-94c8-8480efeba70d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:15.392054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d52f68928a42c3b8a2e584b4b141ec', 'request_id': 'req-d1a592d5-b15a-4eb5-94c8-8480efeba70d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:15.402654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] The token cache is being invalidate because project 24d52f68928a42c3b8a2e584b4b141ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:15.403025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:15.403673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d1a592d5-b15a-4eb5-94c8-8480efeba70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:15.409614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 937/1893] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:15 2022] DELETE /identity/v3/projects/24d52f68928a42c3b8a2e584b4b141ec => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:15.412284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.412565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.412838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.432301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:15.433670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:15.494563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 957/1894] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:15.502326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.502612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.502930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.523291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:15.524490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:15.532922 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 938/1895] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:15.537210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.546765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaa8fd-e2d9-4296-9840-0558221b61d6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.551628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.552276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.552553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.552821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.553544 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:15.553845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.555532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.567603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 958/1896] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:15.571902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.581144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f6bce-d82c-4c05-9ab5-631c74007501 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.586107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.587179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.587545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.587811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.588506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.590391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.638565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 939/1897] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:15 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:15.642387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.654317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dca3c-65d7-4b53-a4d0-0f5f37e52de3 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.725268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.726064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.726397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.726728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.727530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.729725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.752567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 959/1898] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:15 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:15.756513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.768013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d6d05-8c1e-41d3-a59f-80906156661f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.772712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.773464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.773740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.774011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.775014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.776923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.789653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 940/1899] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:15.793777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.803792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf02c44-368f-4cfb-85eb-a77bdfca605d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.810133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996216e-1f8d-4455-9f65-38b040dc3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.810793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996216e-1f8d-4455-9f65-38b040dc3936 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.811086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996216e-1f8d-4455-9f65-38b040dc3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.811352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996216e-1f8d-4455-9f65-38b040dc3936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.812071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996216e-1f8d-4455-9f65-38b040dc3936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.813667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996216e-1f8d-4455-9f65-38b040dc3936 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.823986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 960/1900] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:15.827990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.839274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1ac42-5f68-4326-b7d3-d23c45c01f10 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:15.845510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:15.846654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.846959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.847237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] PATH_INFO: `/v3/projects/570b2249d283476ab85f3544a666d5dd/users/3ee360c0d9254560822f8cc2f4349686/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.863406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570b2249d283476ab85f3544a666d5dd, user_id=3ee360c0d9254560822f8cc2f4349686, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:15.866530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:15.879909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 941/1901] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:15 2022] PUT /identity/v3/projects/570b2249d283476ab85f3544a666d5dd/users/3ee360c0d9254560822f8cc2f4349686/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:15.884978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb1ea-32ba-47f4-8586-16707dfd7e3d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:15.885267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb1ea-32ba-47f4-8586-16707dfd7e3d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:15.885556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb1ea-32ba-47f4-8586-16707dfd7e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:15.907488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-0cbbb1ea-32ba-47f4-8586-16707dfd7e3d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:15.908764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0cbbb1ea-32ba-47f4-8586-16707dfd7e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:15.971568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 961/1902] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:15.981493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:15.983785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:16.041478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f3f8b-d42c-4b38-a574-b47fb5d5e5e3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:16.045966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:16.046622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:16.046916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:16.047185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:16.058189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:16.059748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:16.070074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 942/1903] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:16.809411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:16.809941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:16.809941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:16.837503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] MFA Rules not processed for user `3ee360c0d9254560822f8cc2f4349686`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:16.838709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:16.909944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 962/1904] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:16.915263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:16.924907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f586-70d9-46dc-89ea-d77e28fda972 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:16.929672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:16.930325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:16.930940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:16.931210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:16.931917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:16.933808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:16.959340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 943/1905] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:16.963506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:16.973989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa81294-eaff-483d-b2b1-160a62e3932a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:17.058262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:17.058988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:17.059270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:17.059540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:17.060458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:17.062816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:17.085140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 963/1906] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:16 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:17.088235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:17.098610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3020ac-ed4e-467e-b468-851728acecab admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:17.104551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:17.105217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:17.105492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:17.105769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:17.106551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:17.108227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:17.118991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 944/1907] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:17.124873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:17.136154 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba644-0585-4310-9c0d-ee8a228c24be admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:17.141426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:17.142417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:17.142696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:17.143008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] PATH_INFO: `/v3/projects/20b11b3a1b5f404cacc23eee6296eb4a/users/876b775bfc0840aab56e2b4ea13680f3/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:17.159719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b11b3a1b5f404cacc23eee6296eb4a, user_id=876b775bfc0840aab56e2b4ea13680f3, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:17.162440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:17.175872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 964/1908] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:17 2022] PUT /identity/v3/projects/20b11b3a1b5f404cacc23eee6296eb4a/users/876b775bfc0840aab56e2b4ea13680f3/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:17.180031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:17.190369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a4fce-497c-480a-8b74-7b1415e60ffc admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:17.244839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2505b6-f20b-41aa-b3c7-e4b9e0fbeff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:17.245503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2505b6-f20b-41aa-b3c7-e4b9e0fbeff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:17.245810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2505b6-f20b-41aa-b3c7-e4b9e0fbeff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:17.246079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2505b6-f20b-41aa-b3c7-e4b9e0fbeff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:17.246804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2505b6-f20b-41aa-b3c7-e4b9e0fbeff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:17.248464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2505b6-f20b-41aa-b3c7-e4b9e0fbeff7 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:17.258128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 945/1909] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:17.262603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:17.276270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e15b1-f0c9-40fe-b7e5-940a38adeed5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:17.281451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:17.282361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:17.282630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:17.283271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] PATH_INFO: `/v3/projects/20b11b3a1b5f404cacc23eee6296eb4a/users/876b775bfc0840aab56e2b4ea13680f3/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:17.285281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b11b3a1b5f404cacc23eee6296eb4a, user_id=876b775bfc0840aab56e2b4ea13680f3, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:17.288114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:17.298945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 965/1910] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:17 2022] PUT /identity/v3/projects/20b11b3a1b5f404cacc23eee6296eb4a/users/876b775bfc0840aab56e2b4ea13680f3/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:18.039344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:18.040283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:18.040991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:18.072512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] MFA Rules not processed for user `876b775bfc0840aab56e2b4ea13680f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:18.073824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:18.144551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 946/1911] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:18.156847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:18.158857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:18.219843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9540-504c-492c-afda-06382de1c8b9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:18.223459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:18.224095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:18.224367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:18.224632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:18.280205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:18.281651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:18.290956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 966/1912] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:19.687056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:19.688449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:19.700641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936653ef-c8d9-42a7-9629-e9d7fb4158cd None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:19.704359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8684ee-aea6-40a5-9174-2e783228d9cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:19.705067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8684ee-aea6-40a5-9174-2e783228d9cb service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:19.705429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8684ee-aea6-40a5-9174-2e783228d9cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:19.705768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8684ee-aea6-40a5-9174-2e783228d9cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:19.715105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8684ee-aea6-40a5-9174-2e783228d9cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:19.716604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8684ee-aea6-40a5-9174-2e783228d9cb service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:19.726580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 947/1913] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:21.665752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:21.667774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:21.740592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71146e4f-6f2f-4cc9-81da-3b8ccf0654e3 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:21.745109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:21.745989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:21.746264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:21.746529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] PATH_INFO: `/v3/users/64102990c0094dab90eb30b71155244b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:21.747762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=64102990c0094dab90eb30b71155244b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:21.749708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:21.804244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64102990c0094dab90eb30b71155244b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:21.813314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64102990c0094dab90eb30b71155244b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:21.821650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64102990c0094dab90eb30b71155244b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:21.822378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64102990c0094dab90eb30b71155244b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:21.823079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64102990c0094dab90eb30b71155244b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:21.841326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 967/1914] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:21 2022] DELETE /identity/v3/users/64102990c0094dab90eb30b71155244b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:21.845909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:21.846435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:21.846574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:21.865394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:21.866588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:21.935637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 948/1915] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:21.948529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:21.950221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:22.011667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c86f8-7ac5-475e-8570-f1655adcbcfd admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:22.015592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:22.016319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:22.016665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:22.017173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:22.028256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:22.029800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:22.039638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 968/1916] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:22.535043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:22.536581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:22.558083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae97507-b9a8-488e-ba00-df327bae3a61 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:22.564425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:22.565565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:22.565837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:22.566157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] PATH_INFO: `/v3/projects/0388e4eb20d64f5bac06fca5e36fbdc2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:22.568395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0388e4eb20d64f5bac06fca5e36fbdc2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:22.570688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:22.631739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0388e4eb20d64f5bac06fca5e36fbdc2', 'request_id': 'req-4216869c-4be3-439d-8be1-f3e1db094034'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.637900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0388e4eb20d64f5bac06fca5e36fbdc2', 'request_id': 'req-4216869c-4be3-439d-8be1-f3e1db094034'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.645507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0388e4eb20d64f5bac06fca5e36fbdc2', 'request_id': 'req-4216869c-4be3-439d-8be1-f3e1db094034'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.655642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] The token cache is being invalidate because project 0388e4eb20d64f5bac06fca5e36fbdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:22.656190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.656702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.658478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 949/1917] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:22 2022] DELETE /identity/v3/projects/0388e4eb20d64f5bac06fca5e36fbdc2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:22.662369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:22.672836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751bbd0-a1ec-403a-a0bb-45360d7c20dd service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:22.728331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:22.729082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:22.729355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:22.729622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] PATH_INFO: `/v3/users/832d25a1056240e59fe040295aeaae2b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:22.730850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832d25a1056240e59fe040295aeaae2b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:22.732799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:22.783137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832d25a1056240e59fe040295aeaae2b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.791833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832d25a1056240e59fe040295aeaae2b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.798778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832d25a1056240e59fe040295aeaae2b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.799607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832d25a1056240e59fe040295aeaae2b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.800218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-33352347-d9d5-4fac-b20e-74f9862a1274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832d25a1056240e59fe040295aeaae2b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:22.818556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 969/1918] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:22 2022] DELETE /identity/v3/users/832d25a1056240e59fe040295aeaae2b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:23.093069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.095987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:23.123152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216869c-4be3-439d-8be1-f3e1db094034 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.183224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.184097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.184376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.184800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] PATH_INFO: `/v3/projects/afe3c4b0bda64528b8c59ee607592816` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.188193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe3c4b0bda64528b8c59ee607592816)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.190901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.242127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe3c4b0bda64528b8c59ee607592816', 'request_id': 'req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:23.248981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe3c4b0bda64528b8c59ee607592816', 'request_id': 'req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:23.257800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe3c4b0bda64528b8c59ee607592816', 'request_id': 'req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:23.268220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] The token cache is being invalidate because project afe3c4b0bda64528b8c59ee607592816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:23.268764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:23.269359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a766b6f5-79e6-4fe6-89e4-06f71f0f964e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:23.271184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 950/1919] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:23 2022] DELETE /identity/v3/projects/afe3c4b0bda64528b8c59ee607592816 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:23.276069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.276418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.276738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.297949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:23.299224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:23.360464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 970/1920] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:23.369084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.370255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.370535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.389122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:23.390334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:23.398664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 951/1921] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:23.404214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.414353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebe7da-00bf-41ef-8139-d4d7c92ecec7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.419688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.420539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.420818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.421105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.421827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:23.422128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.423767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.435949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 971/1922] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:23.440402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.449684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92038c-1e01-44da-ab0b-700b44f5023b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.455082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.455741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.456016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.456283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.456963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.458854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.485333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 952/1923] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:23 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:23.489567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.499654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42745be4-a9ec-4f8f-a2f3-a53a821d413a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.561360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.562235 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.562563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.562874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.563662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.565664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.591058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 972/1924] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:23 2022] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:23.595752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.608701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e813-2403-4a00-87ae-654a700918fb admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.613803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.614453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.614822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.615024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.615864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.617654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.628712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 953/1925] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:23.632825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.643280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58d7e7-f8bd-41e3-8b94-42aee0f4928b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.649518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482d501-4c00-4800-963d-bf5e845a7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.650294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482d501-4c00-4800-963d-bf5e845a7c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.650573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482d501-4c00-4800-963d-bf5e845a7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.650841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482d501-4c00-4800-963d-bf5e845a7c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.651606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482d501-4c00-4800-963d-bf5e845a7c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.653190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482d501-4c00-4800-963d-bf5e845a7c10 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.667665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 973/1926] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:17:23.668408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.677906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb20a-9793-4bc4-bc3a-79dd81f32f60 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.682675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.683583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.683858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.684123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] PATH_INFO: `/v3/projects/bfcdc6945d80469c857e791c828d704f/users/1e45e35ae2ae4f0e903b3293250438c3/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.698270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcdc6945d80469c857e791c828d704f, user_id=1e45e35ae2ae4f0e903b3293250438c3, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.700924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.713932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 954/1927] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:23 2022] PUT /identity/v3/projects/bfcdc6945d80469c857e791c828d704f/users/1e45e35ae2ae4f0e903b3293250438c3/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:23.724885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.725348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.725436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.756025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] MFA Rules not processed for user `1e45e35ae2ae4f0e903b3293250438c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:23.757142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:23.824817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 974/1928] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:23.874778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:23.876771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:23.956803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04e907-f467-4c4b-a674-516378584488 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:23.961277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872220e-d7cd-486d-b0c7-833e222866cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:23.961607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872220e-d7cd-486d-b0c7-833e222866cd service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:23.961890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872220e-d7cd-486d-b0c7-833e222866cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:23.962208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872220e-d7cd-486d-b0c7-833e222866cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:23.971195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872220e-d7cd-486d-b0c7-833e222866cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:23.972628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872220e-d7cd-486d-b0c7-833e222866cd service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:23.981657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 955/1929] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:23.996118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:24.056356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570408d7-c8fd-4e28-a0e5-fbd8424e203f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:24.060973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:24.061849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.062133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.062764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] PATH_INFO: `/v3/users/1e45e35ae2ae4f0e903b3293250438c3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.064049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e45e35ae2ae4f0e903b3293250438c3)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:24.065971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:24.112967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e45e35ae2ae4f0e903b3293250438c3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.121733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e45e35ae2ae4f0e903b3293250438c3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.128354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e45e35ae2ae4f0e903b3293250438c3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.128972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e45e35ae2ae4f0e903b3293250438c3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.129569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e45e35ae2ae4f0e903b3293250438c3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.145759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 975/1930] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:23 2022] DELETE /identity/v3/users/1e45e35ae2ae4f0e903b3293250438c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:24.150419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.150906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.151028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.169096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:24.170387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:24.228151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 956/1931] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:24.238024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:24.239511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:24.295694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d71c5-caa2-48fc-b410-c2e39b3a2cf4 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:24.299966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182378-166a-447c-b08d-875302073c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:24.300607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182378-166a-447c-b08d-875302073c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.300885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182378-166a-447c-b08d-875302073c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.301158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182378-166a-447c-b08d-875302073c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.310865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5182378-166a-447c-b08d-875302073c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:24.312334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5182378-166a-447c-b08d-875302073c24 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:24.321893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 976/1932] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:17:24.597450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:24.598930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:24.610985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76bee7-9207-45b1-b3ce-609b261c7005 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:24.616126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:24.617000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.617425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.617695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] PATH_INFO: `/v3/projects/bfcdc6945d80469c857e791c828d704f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.619119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcdc6945d80469c857e791c828d704f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:24.621003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:24.670185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcdc6945d80469c857e791c828d704f', 'request_id': 'req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.676538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcdc6945d80469c857e791c828d704f', 'request_id': 'req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.684837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcdc6945d80469c857e791c828d704f', 'request_id': 'req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.695218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] The token cache is being invalidate because project bfcdc6945d80469c857e791c828d704f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:24.695500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.696178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-87def380-0c1d-4813-94b0-f8c9d9ecbaf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:24.697770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 957/1933] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:24 2022] DELETE /identity/v3/projects/bfcdc6945d80469c857e791c828d704f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:24.702737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.703071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.703351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.721511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:24.722686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:24.785861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 977/1934] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:24.794025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.794515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.794819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.815458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:24.816554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:24.824907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 958/1935] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:24.829671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:24.843062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9247001-1821-47f6-b673-95e0e6df386d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:24.849195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:24.849859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.850139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.850410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.851163 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:24.851439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:24.853110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:24.866526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 978/1936] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:24.876848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:24.886432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469957e3-a7a8-42c2-97bc-8ad7d7967411 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:24.892197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:24.892850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.893127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.893394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.894080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:24.896025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:24.922052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 959/1937] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:24 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:24.926617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:24.936738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64abdf8-be4a-48a4-b3b0-2be3a3e73688 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:24.993965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:24.994726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:24.995045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:24.995318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:24.996045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:24.997965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:25.020170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 979/1938] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:24 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:25.024436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:25.034793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e3172-e60e-4aef-b338-c7a72ecb80a8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:25.046148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:25.046908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:25.047257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:25.048004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:25.048908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:25.050871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:25.064318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 960/1939] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:25.068397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:25.083830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732d7b8-2358-40f2-80fc-39d77d20fabd admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:25.084072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a615c-1f7d-4a86-ad18-8c35db936d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:25.084923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a615c-1f7d-4a86-ad18-8c35db936d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:25.085203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a615c-1f7d-4a86-ad18-8c35db936d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:25.085472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a615c-1f7d-4a86-ad18-8c35db936d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:25.086297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a615c-1f7d-4a86-ad18-8c35db936d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:25.087925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a615c-1f7d-4a86-ad18-8c35db936d02 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:25.099128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 980/1940] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:25.109024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:25.121871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0784-61aa-4eee-8463-b5319ae97214 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:25.128150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:25.129443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:25.129775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:25.130156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] PATH_INFO: `/v3/projects/89d823357b874c73b4f18c68bc71a03b/users/b654d10bf252443fb9420784c52a96cf/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:25.157814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d823357b874c73b4f18c68bc71a03b, user_id=b654d10bf252443fb9420784c52a96cf, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:25.161354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:25.175424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 961/1941] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:25 2022] PUT /identity/v3/projects/89d823357b874c73b4f18c68bc71a03b/users/b654d10bf252443fb9420784c52a96cf/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:25.187855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:25.188143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:25.188419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:25.216085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] MFA Rules not processed for user `b654d10bf252443fb9420784c52a96cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:25.217272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:25.279279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 981/1942] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:25.291626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:25.293441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:25.356248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b340c-6331-42df-81cf-d8c1acd8636c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:25.360475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e972b-8b18-4970-9e60-1ac3b6f82c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:25.361117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e972b-8b18-4970-9e60-1ac3b6f82c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:25.361404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e972b-8b18-4970-9e60-1ac3b6f82c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:25.361677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e972b-8b18-4970-9e60-1ac3b6f82c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:25.371011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e972b-8b18-4970-9e60-1ac3b6f82c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:25.372445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e972b-8b18-4970-9e60-1ac3b6f82c6f service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:25.381347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 962/1943] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:28.494424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:28.567657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5d856-e6f3-4dd1-ab27-7d4491e9ad3b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:28.572860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:28.573742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:28.574020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:28.574291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] PATH_INFO: `/v3/users/b654d10bf252443fb9420784c52a96cf` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:28.575533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b654d10bf252443fb9420784c52a96cf)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:28.577495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:28.623993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b654d10bf252443fb9420784c52a96cf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:28.632664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b654d10bf252443fb9420784c52a96cf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:28.643392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b654d10bf252443fb9420784c52a96cf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:28.644484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b654d10bf252443fb9420784c52a96cf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:28.645301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b654d10bf252443fb9420784c52a96cf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:28.669172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 982/1944] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:28 2022] DELETE /identity/v3/users/b654d10bf252443fb9420784c52a96cf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:28.674028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:28.674621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:28.674867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:28.697372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:28.699174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:28.768193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 963/1945] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:28.778925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:28.783253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:28.846010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa37ed-9839-4235-9488-031277fd700f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:28.850408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b514a-da9b-4e72-b78d-eb3dfa31f2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:28.851156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b514a-da9b-4e72-b78d-eb3dfa31f2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:28.851546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b514a-da9b-4e72-b78d-eb3dfa31f2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:28.851880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b514a-da9b-4e72-b78d-eb3dfa31f2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:28.862430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b514a-da9b-4e72-b78d-eb3dfa31f2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:28.864144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b514a-da9b-4e72-b78d-eb3dfa31f2ca service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:28.875644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 983/1946] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:17:29.164924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.166844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:29.181085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507c6b-d1a1-4170-8d3a-075639a74415 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.186828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.187761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.188038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.188311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] PATH_INFO: `/v3/projects/89d823357b874c73b4f18c68bc71a03b` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.189726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d823357b874c73b4f18c68bc71a03b)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.193987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.243619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d823357b874c73b4f18c68bc71a03b', 'request_id': 'req-15935345-29f1-456d-a3b2-688bb2db2864'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:29.249978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d823357b874c73b4f18c68bc71a03b', 'request_id': 'req-15935345-29f1-456d-a3b2-688bb2db2864'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:29.257468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d823357b874c73b4f18c68bc71a03b', 'request_id': 'req-15935345-29f1-456d-a3b2-688bb2db2864'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:29.268111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] The token cache is being invalidate because project 89d823357b874c73b4f18c68bc71a03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:29.268396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:29.269044 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-15935345-29f1-456d-a3b2-688bb2db2864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:29.270655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 964/1947] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:29 2022] DELETE /identity/v3/projects/89d823357b874c73b4f18c68bc71a03b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:29.276224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.276534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.276819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.294478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:29.295738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:29.361977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 984/1948] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:29.371436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.371966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.372486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.401839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:29.403131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:29.412186 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 965/1949] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:29.416105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.425962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823256c0-6d67-4f3c-b855-f4c4413079c9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.430897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.431569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.431852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.432122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.432843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:29.433143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.434756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.451139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 985/1950] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:29.452651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.464490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97868736-6ca2-4cb3-877b-057dc478ae1c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.469137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.469792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.470236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.470503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.471243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.473141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.498931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 966/1951] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:29 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:29.507976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.512803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773352d-df1a-4636-9c57-575bf34b7a9b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.577852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.578547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.578832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.579116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.579817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.581748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.602442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 986/1952] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:29 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:29.607670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.619183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd6016-0c39-4110-899d-5fa418b0be85 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.624036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.624756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.625031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.625300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.626021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.627660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.638191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 967/1953] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:29.642360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.653169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a979-5aaa-44e1-8d0d-d6fb2f5f2431 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.659100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeffc85-b831-4266-88c4-2039aa78ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.659759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeffc85-b831-4266-88c4-2039aa78ec9b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.660030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeffc85-b831-4266-88c4-2039aa78ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.660298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeffc85-b831-4266-88c4-2039aa78ec9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.661013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeffc85-b831-4266-88c4-2039aa78ec9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.662696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeffc85-b831-4266-88c4-2039aa78ec9b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.673219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 987/1954] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:29.677754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.688596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3e23-5497-4803-8ecd-eb0e5afca30b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.693795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.694672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.694979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.695253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] PATH_INFO: `/v3/projects/463813efb0b4415eb5e7863aa0f1f8a9/users/d334f02fca0a4a39914c4b7fdf1f93af/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.711998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463813efb0b4415eb5e7863aa0f1f8a9, user_id=d334f02fca0a4a39914c4b7fdf1f93af, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.714644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.730287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 968/1955] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:29 2022] PUT /identity/v3/projects/463813efb0b4415eb5e7863aa0f1f8a9/users/d334f02fca0a4a39914c4b7fdf1f93af/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:29.735424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d11ec-2b1c-42d8-857f-f805a67590ee None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.735711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d11ec-2b1c-42d8-857f-f805a67590ee None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.735976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d11ec-2b1c-42d8-857f-f805a67590ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.754078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7d1d11ec-2b1c-42d8-857f-f805a67590ee None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:29.755301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7d1d11ec-2b1c-42d8-857f-f805a67590ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:29.815138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 988/1956] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:29.824911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:29.826799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:29.885939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d98d8-49cb-4dd7-afb9-5c4d52191588 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:29.889863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:29.890512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:29.890791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:29.891104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:29.900420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:29.904012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:29.915652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 969/1957] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:30.679422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:30.680862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:30.681483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:30.713313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] MFA Rules not processed for user `d334f02fca0a4a39914c4b7fdf1f93af`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:30.715142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:30.799110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 989/1958] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:30.810116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:30.811712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:30.884448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecee62-b23d-4755-841e-704cfcefc466 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:30.888070 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:30.888716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:30.888991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:30.889254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:30.897558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:30.899008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:30.907817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 970/1959] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:31.222139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:31.224366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:31.253080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07699d52-33ae-4011-924b-77d75fb59e5b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:31.258014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:31.259028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.259309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.259579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] PATH_INFO: `/v3/users/d3271f562474495488835488c6af980f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.260780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3271f562474495488835488c6af980f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:31.262708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:31.316637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3271f562474495488835488c6af980f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.325768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3271f562474495488835488c6af980f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.332939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3271f562474495488835488c6af980f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.333648 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3271f562474495488835488c6af980f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.334251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-273920a6-baea-453c-b230-ff3e9862bc0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3271f562474495488835488c6af980f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.351001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 990/1960] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:31 2022] DELETE /identity/v3/users/d3271f562474495488835488c6af980f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:31.536276 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:31.547978 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c12f7b-0da6-44d8-8162-10811daa7a2e service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:31.607444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:31.608312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.608588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.608860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] PATH_INFO: `/v3/projects/cf5e9e0befe747a794e1f5372bd1e07c` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.610179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5e9e0befe747a794e1f5372bd1e07c)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:31.612134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:31.667128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5e9e0befe747a794e1f5372bd1e07c', 'request_id': 'req-a2cd9491-0ea4-4935-99af-447bc1d91c32'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.673280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5e9e0befe747a794e1f5372bd1e07c', 'request_id': 'req-a2cd9491-0ea4-4935-99af-447bc1d91c32'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.682398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5e9e0befe747a794e1f5372bd1e07c', 'request_id': 'req-a2cd9491-0ea4-4935-99af-447bc1d91c32'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.693362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] The token cache is being invalidate because project cf5e9e0befe747a794e1f5372bd1e07c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:31.693642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.694311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a2cd9491-0ea4-4935-99af-447bc1d91c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:31.695984 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 971/1961] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:31 2022] DELETE /identity/v3/projects/cf5e9e0befe747a794e1f5372bd1e07c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:31.700975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.701451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.701557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.718839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:31.719973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:31.786381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 991/1962] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:31.794461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.794837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.795138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.815745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:31.816812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:31.825159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 972/1963] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:31.830375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:31.839079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cd83a-c84a-45dd-8b7f-ec41f265e958 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:31.843560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:31.844215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.844492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.844762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.845478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:31.845803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:31.847504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:31.863178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 992/1964] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:31.865518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:31.877181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b2a66-cb7a-4728-b0ba-725a292abc70 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:31.882826 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:31.883586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.883941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.884278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.885142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:31.888020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:31.915654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 973/1965] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:31 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:31.919967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:31.930281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58beb-3ad0-4166-83ce-c8ec878a8404 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:31.994420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:31.995301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:31.995434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:31.995682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:31.996371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:31.998305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:32.023265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 993/1966] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:31 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:32.024557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:32.034540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21ff5-7a18-4c50-8238-5b50f7309f15 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:32.039678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:32.040411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:32.040694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:32.040967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:32.041725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:32.043449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:32.053905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 974/1967] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:17:32.058518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:32.069211 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbf93b-3782-49d4-a4e7-cbb5cda41b1b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:32.074801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dc7e3-59f6-46c7-a987-1d64b10a638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:32.075531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dc7e3-59f6-46c7-a987-1d64b10a638d admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:32.075808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dc7e3-59f6-46c7-a987-1d64b10a638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:32.076076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dc7e3-59f6-46c7-a987-1d64b10a638d admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:32.076945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dc7e3-59f6-46c7-a987-1d64b10a638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:32.078592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dc7e3-59f6-46c7-a987-1d64b10a638d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:32.094012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 994/1968] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:32.095376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:32.105541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dea8cc-ad5b-4f86-8e45-9dcdfdd3944f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:32.110132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745275b4-94ac-4415-b994-7014b933f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:32.111160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745275b4-94ac-4415-b994-7014b933f075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:32.111437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745275b4-94ac-4415-b994-7014b933f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:32.111726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745275b4-94ac-4415-b994-7014b933f075 admin admin] PATH_INFO: `/v3/projects/0b28c87707f348aeb139b5d7265c0789/users/cccc81e11d904ca29828739f4d74e80f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:32.126743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745275b4-94ac-4415-b994-7014b933f075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b28c87707f348aeb139b5d7265c0789, user_id=cccc81e11d904ca29828739f4d74e80f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:32.131637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745275b4-94ac-4415-b994-7014b933f075 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:32.143486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 975/1969] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:32 2022] PUT /identity/v3/projects/0b28c87707f348aeb139b5d7265c0789/users/cccc81e11d904ca29828739f4d74e80f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:32.154537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:32.154826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:32.155148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:32.181630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] MFA Rules not processed for user `cccc81e11d904ca29828739f4d74e80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:32.182962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:32.249060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 995/1970] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:32.256643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:32.256925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:32.257203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:32.263560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:32.265048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:32.274773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] MFA Rules not processed for user `d334f02fca0a4a39914c4b7fdf1f93af`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:32.275979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:32.338106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 976/1971] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:32.341302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7944a-7f03-4973-9ae0-72d48bae81fe None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:32.347196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:32.347856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:32.348133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:32.348536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:32.356710 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:32.358303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:32.369607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 996/1972] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:17:33.259114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:33.261147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:33.338414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f6632-1016-41a9-8ad7-252c508d72fa None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:33.345155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:33.346295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:33.346485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:33.346788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] PATH_INFO: `/v3/users/3ee360c0d9254560822f8cc2f4349686` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:33.348022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee360c0d9254560822f8cc2f4349686)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:33.350745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:33.401640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee360c0d9254560822f8cc2f4349686'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.412624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee360c0d9254560822f8cc2f4349686'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.420450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee360c0d9254560822f8cc2f4349686'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.421159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee360c0d9254560822f8cc2f4349686'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.433324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee360c0d9254560822f8cc2f4349686'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.439586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 977/1973] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:33 2022] DELETE /identity/v3/users/3ee360c0d9254560822f8cc2f4349686 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:33.618918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:33.630722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e393712-e8f2-491a-bbdc-ad8d5bc0e147 service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:33.698189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:33.699089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:33.699364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:33.699630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] PATH_INFO: `/v3/projects/570b2249d283476ab85f3544a666d5dd` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:33.700782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] RBAC: Authorizing `identity:delete_project(project_id=570b2249d283476ab85f3544a666d5dd)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:33.702766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:33.749306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570b2249d283476ab85f3544a666d5dd', 'request_id': 'req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.756851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570b2249d283476ab85f3544a666d5dd', 'request_id': 'req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.764100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570b2249d283476ab85f3544a666d5dd', 'request_id': 'req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.775267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] The token cache is being invalidate because project 570b2249d283476ab85f3544a666d5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:33.775555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.776225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.777854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 997/1974] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:33 2022] DELETE /identity/v3/projects/570b2249d283476ab85f3544a666d5dd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:33.782098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:33.783595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:33.796662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7bc03-e40b-420c-b610-e5090bb44258 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:33.855671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:33.857187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:33.857607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:33.857949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] PATH_INFO: `/v3/users/876b775bfc0840aab56e2b4ea13680f3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:33.859928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=876b775bfc0840aab56e2b4ea13680f3)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:33.863418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:33.917755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876b775bfc0840aab56e2b4ea13680f3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.926537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876b775bfc0840aab56e2b4ea13680f3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.934052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876b775bfc0840aab56e2b4ea13680f3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.934743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876b775bfc0840aab56e2b4ea13680f3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.946766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97ae5dae-b583-412a-a8bd-5eaffb721e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876b775bfc0840aab56e2b4ea13680f3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:33.952893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 978/1975] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:33 2022] DELETE /identity/v3/users/876b775bfc0840aab56e2b4ea13680f3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:34.129945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.131430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:34.145739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1b71d-e9de-45bf-a677-b4b96aa9111b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.208438 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.218425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.218425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.218425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] PATH_INFO: `/v3/projects/20b11b3a1b5f404cacc23eee6296eb4a` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.218425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b11b3a1b5f404cacc23eee6296eb4a)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.218425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.278538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b11b3a1b5f404cacc23eee6296eb4a', 'request_id': 'req-6636166e-4e80-496a-b17a-1b990af2c9c1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:34.287680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b11b3a1b5f404cacc23eee6296eb4a', 'request_id': 'req-6636166e-4e80-496a-b17a-1b990af2c9c1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:34.296172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b11b3a1b5f404cacc23eee6296eb4a', 'request_id': 'req-6636166e-4e80-496a-b17a-1b990af2c9c1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:34.308202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] The token cache is being invalidate because project 20b11b3a1b5f404cacc23eee6296eb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:34.308484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:34.309114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6636166e-4e80-496a-b17a-1b990af2c9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:34.310714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 998/1976] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:34 2022] DELETE /identity/v3/projects/20b11b3a1b5f404cacc23eee6296eb4a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:34.316496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.316953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.317109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.340144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:34.341343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:34.402940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 979/1977] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:34.411704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.411987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.412263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.432874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:34.434192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:34.442928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 999/1978] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:34.446840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.458111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc56f66-8701-4a43-9538-4d33d011636c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.463108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.463792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.464068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.464346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.465067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:34.465367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.466992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.482931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 980/1979] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:34.484466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.494430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d24b72-3382-4bb8-a450-3420298d9068 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.499833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.500539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.501190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.501190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.501978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.503985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.529800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1000/1980] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:34 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:34.533936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.544644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170748f2-b35d-43ea-902d-14c40b77f9f8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.602497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.603204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.603482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.603752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.604464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.606471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.637554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 981/1981] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:34 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:34.638671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.655403 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709458-3772-4424-9b3b-8aa0297b94b5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.660283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.661419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.661873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.662240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.663336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.665411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.678730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1001/1982] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:34.683034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.693704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d81e8d-e5b1-4092-bd46-679147dc43ff admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.698633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809bdc5-ba23-44a5-82c9-c29a9e83eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.699403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809bdc5-ba23-44a5-82c9-c29a9e83eb2a admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.699744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809bdc5-ba23-44a5-82c9-c29a9e83eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.700076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809bdc5-ba23-44a5-82c9-c29a9e83eb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.700890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809bdc5-ba23-44a5-82c9-c29a9e83eb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.702680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809bdc5-ba23-44a5-82c9-c29a9e83eb2a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.713607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 982/1983] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:34.718075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.728024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39444-99ae-45c2-a692-0711564099fd admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.732771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.733658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.733933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.734198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] PATH_INFO: `/v3/projects/50588666dc9741ac89970aa6af7e703a/users/befe5196e6554ac49dad036256fb70d2/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.749271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50588666dc9741ac89970aa6af7e703a, user_id=befe5196e6554ac49dad036256fb70d2, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.752071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.764898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1002/1984] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:34 2022] PUT /identity/v3/projects/50588666dc9741ac89970aa6af7e703a/users/befe5196e6554ac49dad036256fb70d2/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:34.779473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.779732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.780007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.809403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] MFA Rules not processed for user `befe5196e6554ac49dad036256fb70d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:34.810623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:34.879054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 983/1985] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:34.887001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:34.888953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:34.948157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655cd1-be79-4692-8f1a-4ef363df2001 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:34.952051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef9b00-7439-4fc2-8dee-2bc995031985 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:34.952921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef9b00-7439-4fc2-8dee-2bc995031985 service glance] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:34.953193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef9b00-7439-4fc2-8dee-2bc995031985 service glance] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:34.953453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef9b00-7439-4fc2-8dee-2bc995031985 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:34.962375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef9b00-7439-4fc2-8dee-2bc995031985 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:34.964044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef9b00-7439-4fc2-8dee-2bc995031985 service glance] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:34.975681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1003/1986] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:35.379562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:35.393003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:35.500768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2dee2-b3f8-43ad-b74c-a54bee6e6451 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:35.505695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:35.507065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:35.507484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:35.507884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] PATH_INFO: `/v3/users/cccc81e11d904ca29828739f4d74e80f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:35.509610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cccc81e11d904ca29828739f4d74e80f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:35.511751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:35.559803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cccc81e11d904ca29828739f4d74e80f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:35.567576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cccc81e11d904ca29828739f4d74e80f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:35.575479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cccc81e11d904ca29828739f4d74e80f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:35.576260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cccc81e11d904ca29828739f4d74e80f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:35.588664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cccc81e11d904ca29828739f4d74e80f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:35.595378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 984/1987] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:35 2022] DELETE /identity/v3/users/cccc81e11d904ca29828739f4d74e80f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:35.600270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388b9b4-d808-4a45-8fd2-c8d96ba171b3 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:35.600523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388b9b4-d808-4a45-8fd2-c8d96ba171b3 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:35.600992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388b9b4-d808-4a45-8fd2-c8d96ba171b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:35.618157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e388b9b4-d808-4a45-8fd2-c8d96ba171b3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:35.620065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e388b9b4-d808-4a45-8fd2-c8d96ba171b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:35.687312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1004/1988] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:35.699006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:35.701156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:35.793934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8aba-aa1a-4612-8421-bf79f8e6b084 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:35.795414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2b61-a562-413f-8e13-7c67c942fd0a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:35.795714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2b61-a562-413f-8e13-7c67c942fd0a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:35.795998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb2b61-a562-413f-8e13-7c67c942fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:35.798323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:35.799019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:35.799283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:35.799554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:35.809914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:35.812131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:35.814780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e7cb2b61-a562-413f-8e13-7c67c942fd0a None None] MFA Rules not processed for user `599e6fd88ed348eab5de9a6330daf477`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:35.816108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e7cb2b61-a562-413f-8e13-7c67c942fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:35.823728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 985/1989] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:35.884469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1005/1990] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:17:36.376217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.377324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:36.396791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d10e-97e0-4e4e-a537-973c1a650e4f service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.403566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.404737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.405181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.405658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] PATH_INFO: `/v3/projects/0b28c87707f348aeb139b5d7265c0789` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.407045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b28c87707f348aeb139b5d7265c0789)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:36.410522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:36.474620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b28c87707f348aeb139b5d7265c0789', 'request_id': 'req-c90f171e-69bc-448f-9eb9-392805b6bae3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:36.482862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b28c87707f348aeb139b5d7265c0789', 'request_id': 'req-c90f171e-69bc-448f-9eb9-392805b6bae3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:36.496477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b28c87707f348aeb139b5d7265c0789', 'request_id': 'req-c90f171e-69bc-448f-9eb9-392805b6bae3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:36.520178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] The token cache is being invalidate because project 0b28c87707f348aeb139b5d7265c0789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:36.521879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:36.525515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c90f171e-69bc-448f-9eb9-392805b6bae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:36.527257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 986/1991] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:36 2022] DELETE /identity/v3/projects/0b28c87707f348aeb139b5d7265c0789 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:17:36.532439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.532727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.533056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.566987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:36.567917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:36.642853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1006/1992] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:36.650778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.651178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.651457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.675664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:36.677256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:36.691569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 987/1993] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:36.693011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.703293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0644-3400-4f9e-b0c9-ac9f75528990 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.708000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.710985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.711330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.711761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.712677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:36.712993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:36.714739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:36.728736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1007/1994] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:36.733306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.746391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb264f-1d6e-4647-af1c-3b8bc61bc1d1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.751999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.752667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.752943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.753228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.753932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:36.755866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:36.785890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 988/1995] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:36 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:36.790781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.803297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40994c65-4b27-4f25-a75d-99b1312ecb85 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.875465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.876217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.876499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.876769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.877496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:36.879550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:36.904114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1008/1996] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:36 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:36.906494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.916776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda4f17-44a3-45c6-9616-aa5056dd5602 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.925030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.926394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.926735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.927101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.927898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:36.929525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:36.940954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 989/1997] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:36.945130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.956988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa6b5-5725-4d1e-8dde-8a3341c778f5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.963250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4db16-5634-4ed6-b3ba-75f63664cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.963933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4db16-5634-4ed6-b3ba-75f63664cd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.964212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4db16-5634-4ed6-b3ba-75f63664cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:36.964479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4db16-5634-4ed6-b3ba-75f63664cd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:36.965208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4db16-5634-4ed6-b3ba-75f63664cd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:36.966825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4db16-5634-4ed6-b3ba-75f63664cd82 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:36.977601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1009/1998] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:36.982019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:36.992882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5eac-bd1a-4f26-a5ce-35cda2c5f677 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:36.998161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:36.999275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:36.999713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:37.000557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] PATH_INFO: `/v3/projects/e7bef5b9e7794f489ea4310d749ee77c/users/792a8bd1677d4cfd84f0568f250efcd3/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:37.015893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bef5b9e7794f489ea4310d749ee77c, user_id=792a8bd1677d4cfd84f0568f250efcd3, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:37.018528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:37.031293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 990/1999] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:36 2022] PUT /identity/v3/projects/e7bef5b9e7794f489ea4310d749ee77c/users/792a8bd1677d4cfd84f0568f250efcd3/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:37.043150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:37.043699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:37.044518 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:37.074099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] MFA Rules not processed for user `792a8bd1677d4cfd84f0568f250efcd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:37.075440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:37.153341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1010/2000] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:37.163658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:37.165526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:37.221734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d44f5-761e-46a3-8105-b6d13ca79acb admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:37.226395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b24c3c-cb0c-4582-84ff-7a8bb94eabcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:37.227131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b24c3c-cb0c-4582-84ff-7a8bb94eabcb service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:37.227408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b24c3c-cb0c-4582-84ff-7a8bb94eabcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:37.227671 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b24c3c-cb0c-4582-84ff-7a8bb94eabcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:37.236769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b24c3c-cb0c-4582-84ff-7a8bb94eabcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:37.238196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b24c3c-cb0c-4582-84ff-7a8bb94eabcb service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:37.247491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 991/2001] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:45.763180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:45.831649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874ecd-8990-41b6-90ba-b331c8e6baf5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:45.836872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:45.837742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:45.838016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:45.838265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] PATH_INFO: `/v3/users/792a8bd1677d4cfd84f0568f250efcd3` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:45.839531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792a8bd1677d4cfd84f0568f250efcd3)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:45.841466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:45.890392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792a8bd1677d4cfd84f0568f250efcd3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:45.897707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792a8bd1677d4cfd84f0568f250efcd3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:45.904410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792a8bd1677d4cfd84f0568f250efcd3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:45.905150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792a8bd1677d4cfd84f0568f250efcd3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:45.905858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792a8bd1677d4cfd84f0568f250efcd3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:45.923972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1011/2002] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:45 2022] DELETE /identity/v3/users/792a8bd1677d4cfd84f0568f250efcd3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:45.928793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:45.929370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:45.929459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:45.949095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:45.950439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:46.014116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 992/2003] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:46.023816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.025318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:46.086225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de474e-84d9-4e8f-aa00-2dbd03bc6301 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.090846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11763f-f749-4a22-904f-1e979cfb99c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.091562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11763f-f749-4a22-904f-1e979cfb99c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.091839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11763f-f749-4a22-904f-1e979cfb99c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.092094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11763f-f749-4a22-904f-1e979cfb99c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.102306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11763f-f749-4a22-904f-1e979cfb99c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.103816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11763f-f749-4a22-904f-1e979cfb99c0 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.114489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1012/2004] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:46.399103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.400577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:46.412560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1890b9-efd5-4d84-817f-fd97ae9c20d5 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.417151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.418019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.418314 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.418567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] PATH_INFO: `/v3/projects/e7bef5b9e7794f489ea4310d749ee77c` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.420233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bef5b9e7794f489ea4310d749ee77c)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.422287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.472406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bef5b9e7794f489ea4310d749ee77c', 'request_id': 'req-1ef125c3-5803-49e2-8a4b-2f738855630e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:46.481022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bef5b9e7794f489ea4310d749ee77c', 'request_id': 'req-1ef125c3-5803-49e2-8a4b-2f738855630e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:46.490607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bef5b9e7794f489ea4310d749ee77c', 'request_id': 'req-1ef125c3-5803-49e2-8a4b-2f738855630e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:46.501179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] The token cache is being invalidate because project e7bef5b9e7794f489ea4310d749ee77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:46.501462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:46.502309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef125c3-5803-49e2-8a4b-2f738855630e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:46.504003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 993/2005] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:46 2022] DELETE /identity/v3/projects/e7bef5b9e7794f489ea4310d749ee77c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:46.509747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.510028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.510351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.529513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:46.530609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:46.592056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1013/2006] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:46.601451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.601769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.602050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.623116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:46.624370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:46.632726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 994/2007] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:46.637521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.647711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91743a-45aa-4d95-90d7-ff8307bc9b92 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.652566 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.653231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.653509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.653777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.654537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:46.654837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.656459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.670314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1014/2008] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:17:46.674014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.685882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96881b0-a63b-4ad0-a7a1-79e1d58c5e1a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.692727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.694239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.694713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.695235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.696719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.699681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.729629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 995/2009] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:46 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:46.730822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.741623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b56f-8fd8-4455-b9f6-b0910c9aa4d6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.804141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.804851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.805533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.805709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.806379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.808354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.830510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1015/2010] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:46 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:46.834524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.844660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf2259-ceff-4c0d-b489-802d2d99f8ca admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.849170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.849821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.850101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.850373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.851134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.852784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.863529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 996/2011] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:46.868125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.878161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06437a-e523-403b-ba41-e3fa092174d8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.882904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0620724-0d32-497a-8f9f-c866e6b1ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.883622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0620724-0d32-497a-8f9f-c866e6b1ea3e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.883904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0620724-0d32-497a-8f9f-c866e6b1ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.884177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0620724-0d32-497a-8f9f-c866e6b1ea3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.884902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0620724-0d32-497a-8f9f-c866e6b1ea3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.886509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0620724-0d32-497a-8f9f-c866e6b1ea3e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.896974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1016/2012] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:46.901109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:46.911281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c459a5-b9d9-4114-ab8b-03e8021f8272 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:46.916366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:46.917247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.917528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.917801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] PATH_INFO: `/v3/projects/40629c6725fe44738bc7b13cebb4f63a/users/9df7ea8966424710b15c3276c4295abc/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.933223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40629c6725fe44738bc7b13cebb4f63a, user_id=9df7ea8966424710b15c3276c4295abc, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:46.936109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:46.950858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 997/2013] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:46 2022] PUT /identity/v3/projects/40629c6725fe44738bc7b13cebb4f63a/users/9df7ea8966424710b15c3276c4295abc/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:46.961584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:46.961869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:46.962141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:46.989182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] MFA Rules not processed for user `9df7ea8966424710b15c3276c4295abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:46.990492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:47.054457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1017/2014] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:47.059916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.126466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03fa70-5fdd-4ef0-a289-29337dfbd9e1 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.133249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.133917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.134220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.134489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.135241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.137158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.167609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 998/2015] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:47 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:17:47.171905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.183793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff73d91-08cf-4bc7-885c-0a50ec38ebb6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.247523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.248213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.248496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.248773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.249468 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.251442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.276735 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1018/2016] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:47 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:47.280918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.292681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770535d-3fd7-4dbb-949e-9d35cb2aea3b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.298271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.298976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.299254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.299518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.300247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.301829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.314517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 999/2017] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:47.319359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.329906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e20971-3374-4113-ac16-d6e807f77546 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.335084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.336331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.336605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.336944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] PATH_INFO: `/v3/projects/02d4d6e5b82e4635b67be8073d2961bd/users/5c6d0b3e6b8f408fbd50fbc6555b3106/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.358267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d4d6e5b82e4635b67be8073d2961bd, user_id=5c6d0b3e6b8f408fbd50fbc6555b3106, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.361029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.377024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1019/2018] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:47 2022] PUT /identity/v3/projects/02d4d6e5b82e4635b67be8073d2961bd/users/5c6d0b3e6b8f408fbd50fbc6555b3106/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:47.381223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.393703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254146f7-aeb2-46a0-9a38-ee72fe395835 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.475132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04dd70-2e3c-46c9-a0f9-6b29bcc93485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.475821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04dd70-2e3c-46c9-a0f9-6b29bcc93485 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.476161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04dd70-2e3c-46c9-a0f9-6b29bcc93485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.476440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04dd70-2e3c-46c9-a0f9-6b29bcc93485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.477242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04dd70-2e3c-46c9-a0f9-6b29bcc93485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.478957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04dd70-2e3c-46c9-a0f9-6b29bcc93485 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.491053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1000/2019] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:17:47.495422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.506604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d828f1-e31c-4370-b1c5-436a593b7901 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.512151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.513048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.513470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.513869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] PATH_INFO: `/v3/projects/02d4d6e5b82e4635b67be8073d2961bd/users/5c6d0b3e6b8f408fbd50fbc6555b3106/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.516394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d4d6e5b82e4635b67be8073d2961bd, user_id=5c6d0b3e6b8f408fbd50fbc6555b3106, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.519420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.541063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1020/2020] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:47 2022] PUT /identity/v3/projects/02d4d6e5b82e4635b67be8073d2961bd/users/5c6d0b3e6b8f408fbd50fbc6555b3106/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:17:47.542926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.543214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.543489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.580606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] MFA Rules not processed for user `5c6d0b3e6b8f408fbd50fbc6555b3106`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:47.582537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:47.651752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1001/2021] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:47.662731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:47.664821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:47.734735 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd8c63-12cd-42b0-8303-4622cd4dcd44 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:47.739714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818aa59-2851-44b3-bb44-8a0a1a9552ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:47.740389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818aa59-2851-44b3-bb44-8a0a1a9552ce service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:47.740665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818aa59-2851-44b3-bb44-8a0a1a9552ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:47.740931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818aa59-2851-44b3-bb44-8a0a1a9552ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:47.752181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818aa59-2851-44b3-bb44-8a0a1a9552ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:47.753683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818aa59-2851-44b3-bb44-8a0a1a9552ce service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:47.764495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1021/2022] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:49.193048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:49.253457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb25ec-5a70-4acb-a93a-81d1cf0547ea None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:49.258406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:49.259316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:49.259597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:49.259856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] PATH_INFO: `/v3/users/9df7ea8966424710b15c3276c4295abc` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:49.261113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df7ea8966424710b15c3276c4295abc)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:49.263275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:49.312458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df7ea8966424710b15c3276c4295abc'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.321566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df7ea8966424710b15c3276c4295abc'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.328486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df7ea8966424710b15c3276c4295abc'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.329137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df7ea8966424710b15c3276c4295abc'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.341175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df7ea8966424710b15c3276c4295abc'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.347494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1002/2023] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:49 2022] DELETE /identity/v3/users/9df7ea8966424710b15c3276c4295abc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:49.352120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb86a7-c4b5-4c04-886c-19083a4d91f7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:49.352596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb86a7-c4b5-4c04-886c-19083a4d91f7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:49.352685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb86a7-c4b5-4c04-886c-19083a4d91f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:49.371109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8acb86a7-c4b5-4c04-886c-19083a4d91f7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:49.372345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8acb86a7-c4b5-4c04-886c-19083a4d91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:49.436340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1022/2024] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:49.446183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:49.447699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:49.506042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014df25-e5ab-44bb-9cd8-8f8f19244a22 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:49.510067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:49.510708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:49.511020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:49.511295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:49.520682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:49.522094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:49.531751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1003/2025] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:17:49.723704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:49.723970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:49.724254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:49.742695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] MFA Rules not processed for user `d334f02fca0a4a39914c4b7fdf1f93af`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:49.743955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:49.802270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1023/2026] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:49.814194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:49.815819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:49.833495 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ce6b2-2cd1-4aa4-b87a-57ff69e0a7f0 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:49.838603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:49.839512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:49.839793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:49.840072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] PATH_INFO: `/v3/projects/40629c6725fe44738bc7b13cebb4f63a` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:49.841339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40629c6725fe44738bc7b13cebb4f63a)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:49.843750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:49.900607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40629c6725fe44738bc7b13cebb4f63a', 'request_id': 'req-39ccadf5-0d43-4825-a5fc-433298284ff0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.907709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40629c6725fe44738bc7b13cebb4f63a', 'request_id': 'req-39ccadf5-0d43-4825-a5fc-433298284ff0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.915138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40629c6725fe44738bc7b13cebb4f63a', 'request_id': 'req-39ccadf5-0d43-4825-a5fc-433298284ff0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.925632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] The token cache is being invalidate because project 40629c6725fe44738bc7b13cebb4f63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:49.925920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.926542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:49.928169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1004/2027] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:49 2022] DELETE /identity/v3/projects/40629c6725fe44738bc7b13cebb4f63a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:49.932506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:49.944011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b827-f37f-4197-b727-73906187df83 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.003213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.004174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.004490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.004762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] PATH_INFO: `/v3/users/5c6d0b3e6b8f408fbd50fbc6555b3106` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.006106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6d0b3e6b8f408fbd50fbc6555b3106)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.007980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.059934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6d0b3e6b8f408fbd50fbc6555b3106'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.071895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6d0b3e6b8f408fbd50fbc6555b3106'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.080046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6d0b3e6b8f408fbd50fbc6555b3106'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.080944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6d0b3e6b8f408fbd50fbc6555b3106'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.081530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16c4e671-feff-41a3-910d-4e4ccf6c78d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6d0b3e6b8f408fbd50fbc6555b3106'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.099040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1024/2028] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:17:49 2022] DELETE /identity/v3/users/5c6d0b3e6b8f408fbd50fbc6555b3106 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:50.399581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.401486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:50.418293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccadf5-0d43-4825-a5fc-433298284ff0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.479158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.480063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.480323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.480836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] PATH_INFO: `/v3/projects/02d4d6e5b82e4635b67be8073d2961bd` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.483516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d4d6e5b82e4635b67be8073d2961bd)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.489612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.546606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d4d6e5b82e4635b67be8073d2961bd', 'request_id': 'req-bcf3b23d-3e39-4534-bca4-1b4e58672650'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.553699 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d4d6e5b82e4635b67be8073d2961bd', 'request_id': 'req-bcf3b23d-3e39-4534-bca4-1b4e58672650'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.566486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d4d6e5b82e4635b67be8073d2961bd', 'request_id': 'req-bcf3b23d-3e39-4534-bca4-1b4e58672650'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.573745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] The token cache is being invalidate because project 02d4d6e5b82e4635b67be8073d2961bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:17:50.574029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.574668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-bcf3b23d-3e39-4534-bca4-1b4e58672650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:17:50.576458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1005/2029] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:17:50 2022] DELETE /identity/v3/projects/02d4d6e5b82e4635b67be8073d2961bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:17:50.582392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.582863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.582976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.601401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:50.602603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:50.676453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1025/2030] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:50.686353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.686631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.686913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.706376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:50.707708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:50.715787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1006/2031] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:50.720042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.729554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4bad1-fcab-4cf4-b737-3fdd8633260f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.734154 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.734931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.735448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.735805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.736586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:17:50.737097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.738924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.751081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1026/2032] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:17:50.755232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.765151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606003a-6688-4a6f-aaff-a95e00c96c72 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.769753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.770437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.770713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.771006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.771867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.773864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.807228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1007/2033] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:17:50 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:50.808452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.818641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf09fb2-28d9-48e5-bf59-19ac2f56653e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.881955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.882620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.882952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.883234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.883908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.886231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.907022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1027/2034] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:17:50 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:17:50.911176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.921690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29181f-c871-40b4-9e2d-32849dfab7c9 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.926589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.927287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.927567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.927825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.928597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.930587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.942582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1008/2035] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:50.946704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.956926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66591f85-8cc7-491a-a098-46c7409e8e6f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.962381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24c56a-e47e-4741-a017-c97d74fca421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:50.963146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c56a-e47e-4741-a017-c97d74fca421 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:50.963429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c56a-e47e-4741-a017-c97d74fca421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:50.963759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c56a-e47e-4741-a017-c97d74fca421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:50.964492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c56a-e47e-4741-a017-c97d74fca421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:50.966099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c56a-e47e-4741-a017-c97d74fca421 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:50.976633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1028/2036] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:17:50.980847 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:50.991254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01b593-0ac7-4200-bcc5-3680ebf5fc87 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:50.999295 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:51.000227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:51.000471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:51.000933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] PATH_INFO: `/v3/projects/936b8789b955411ba7f665d1b49b60f4/users/fd090e1befb046f3875bf50e386f2aa7/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:51.016859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=936b8789b955411ba7f665d1b49b60f4, user_id=fd090e1befb046f3875bf50e386f2aa7, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:51.019811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:51.033581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1009/2037] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:17:50 2022] PUT /identity/v3/projects/936b8789b955411ba7f665d1b49b60f4/users/fd090e1befb046f3875bf50e386f2aa7/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:17:51.043824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:51.044119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:51.044394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:51.071588 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] MFA Rules not processed for user `fd090e1befb046f3875bf50e386f2aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:17:51.073247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:51.138524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1029/2038] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:17:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:17:51.151240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:17:51.153090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:17:51.211844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd907b-dd9b-484e-8fec-064aca283ada admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:17:51.215610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:17:51.216255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:17:51.216531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:17:51.216799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:17:51.225327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:17:51.226836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:17:51.236883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1010/2039] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:17:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:03.293637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:03.295599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:03.351777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146fbd6-fe74-4132-ae08-19f26a746796 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:03.355722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:03.356363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:03.356639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:03.356918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:03.359070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:03.424968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:03.426453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5f43-0108-451f-b1a2-5c28fccc8b78 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:03.438194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1030/2040] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:19.000565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:19.002130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:19.132724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dec61-3993-4713-b34b-40de1a3fbe28 service glance] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:19.138210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:19.139253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.139531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.139801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] PATH_INFO: `/v3/users/befe5196e6554ac49dad036256fb70d2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.141113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=befe5196e6554ac49dad036256fb70d2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:19.143065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:19.206959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'befe5196e6554ac49dad036256fb70d2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.214399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'befe5196e6554ac49dad036256fb70d2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.221145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'befe5196e6554ac49dad036256fb70d2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.221829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'befe5196e6554ac49dad036256fb70d2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.233367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'befe5196e6554ac49dad036256fb70d2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.239990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1011/2041] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:18:18 2022] DELETE /identity/v3/users/befe5196e6554ac49dad036256fb70d2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:19.244676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40525cf-8e3a-4bac-ba28-71cf734b405a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.245157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40525cf-8e3a-4bac-ba28-71cf734b405a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.245246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40525cf-8e3a-4bac-ba28-71cf734b405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.273889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c40525cf-8e3a-4bac-ba28-71cf734b405a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:19.275191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c40525cf-8e3a-4bac-ba28-71cf734b405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:19.335237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1031/2042] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:19.344909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:19.346448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:19.445435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53fa77-8ea0-4745-899e-258a80132f8f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:19.449284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:19.449925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.450199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.450465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.460258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:19.461741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:19.471708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1012/2043] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:19.524132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.524756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.525123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.575852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:19.577088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:19.645548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1032/2044] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:19.703849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:19.705325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:19.774165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722dc3d-7956-4d7b-9a5d-e85f58dd1dab service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:19.774300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:19.775736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:19.780110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1776ab0-25c4-452a-8ab0-8b71f0345639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:19.780775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776ab0-25c4-452a-8ab0-8b71f0345639 service swift] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.781078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776ab0-25c4-452a-8ab0-8b71f0345639 service swift] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.781329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1776ab0-25c4-452a-8ab0-8b71f0345639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.789863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1776ab0-25c4-452a-8ab0-8b71f0345639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:19.790461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dc1f-dca9-4c41-b053-09062dd38bf1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:19.791643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1776ab0-25c4-452a-8ab0-8b71f0345639 service swift] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:19.795855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:19.797387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.797733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.798067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] PATH_INFO: `/v3/projects/50588666dc9741ac89970aa6af7e703a` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.799758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50588666dc9741ac89970aa6af7e703a)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:19.800455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1013/2045] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 08:18:19.807859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:19.870591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50588666dc9741ac89970aa6af7e703a', 'request_id': 'req-d96c0bde-b201-42f8-926b-ee4dc1ebec73'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.879955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50588666dc9741ac89970aa6af7e703a', 'request_id': 'req-d96c0bde-b201-42f8-926b-ee4dc1ebec73'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.887112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50588666dc9741ac89970aa6af7e703a', 'request_id': 'req-d96c0bde-b201-42f8-926b-ee4dc1ebec73'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.898042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] The token cache is being invalidate because project 50588666dc9741ac89970aa6af7e703a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:18:19.898333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.899034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d96c0bde-b201-42f8-926b-ee4dc1ebec73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:19.900608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1033/2046] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:18:19 2022] DELETE /identity/v3/projects/50588666dc9741ac89970aa6af7e703a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:18:19.905645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:19.905929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:19.906200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:19.954806 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:19.956163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:20.042665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1014/2047] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:20.052168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.052789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.053779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.082284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:20.083908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:20.093972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1034/2048] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:20.097858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.109075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a965c-1ba5-40fd-8982-678167c4e369 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.118834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.119693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.120210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.120760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.121815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:18:20.122265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.124253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.142004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1015/2049] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:18:20.143160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.152606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e1ea-0877-476a-92e5-c6bf4f4a428a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.157612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.158330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.158527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.158789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.159640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.161513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.190917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1035/2050] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:18:20 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:18:20.196055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.208097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18848e3d-7646-4dfd-b9ae-23971a30ec14 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.267321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.268030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.268369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.268568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.269375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.271357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.303115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1016/2051] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:18:20 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:20.303986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.315874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5775d-c442-41e7-af76-0805ce4e2f23 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.322651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.323048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.323501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.323841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.324920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.326839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.340259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1036/2052] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:20.345660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.364513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c56d-ce27-497a-80e8-e1036d90f720 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.370300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ed274-919b-49f9-baf8-111d1b948d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.371225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ed274-919b-49f9-baf8-111d1b948d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.371591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ed274-919b-49f9-baf8-111d1b948d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.371870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ed274-919b-49f9-baf8-111d1b948d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.372604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ed274-919b-49f9-baf8-111d1b948d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.374260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ed274-919b-49f9-baf8-111d1b948d52 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.396777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1017/2053] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:20.398242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.418783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13062892-75db-4001-bd7a-26c1a13cb408 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.423797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.424905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.425503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.425924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] PATH_INFO: `/v3/projects/6ba19a2b064a49109c40d335ac3b1863/users/a15d386a74d645caaef2dac8250f9a92/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.453607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba19a2b064a49109c40d335ac3b1863, user_id=a15d386a74d645caaef2dac8250f9a92, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.456619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.474609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1037/2054] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:18:20 2022] PUT /identity/v3/projects/6ba19a2b064a49109c40d335ac3b1863/users/a15d386a74d645caaef2dac8250f9a92/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:20.492497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32f0f-1a8b-4db7-a2b9-199084f5635f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.493103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32f0f-1a8b-4db7-a2b9-199084f5635f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.493525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32f0f-1a8b-4db7-a2b9-199084f5635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.526246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f9c32f0f-1a8b-4db7-a2b9-199084f5635f None None] MFA Rules not processed for user `a15d386a74d645caaef2dac8250f9a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:20.527485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f9c32f0f-1a8b-4db7-a2b9-199084f5635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:20.635445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1018/2055] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:20.643882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:20.645676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:20.738907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6aaed-a85d-418e-9498-41818e54fc15 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:20.743491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:20.744476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:20.744978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:20.745399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:20.755671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:20.757546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:20.770493 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1038/2056] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:22.336252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104778-4ea3-42ca-845d-4e14f339c662 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:22.336774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104778-4ea3-42ca-845d-4e14f339c662 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:22.336874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44104778-4ea3-42ca-845d-4e14f339c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:22.372375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-44104778-4ea3-42ca-845d-4e14f339c662 None None] MFA Rules not processed for user `a15d386a74d645caaef2dac8250f9a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:22.374042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-44104778-4ea3-42ca-845d-4e14f339c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:22.409378 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1019/2057] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:31.318339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:31.320698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:31.434582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3f1bb-91f5-42fe-b031-487013234455 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:31.440226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:31.442528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:31.443397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:31.443889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] PATH_INFO: `/v3/users/fd090e1befb046f3875bf50e386f2aa7` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:31.446004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd090e1befb046f3875bf50e386f2aa7)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:31.455460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:31.523379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd090e1befb046f3875bf50e386f2aa7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:31.533728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd090e1befb046f3875bf50e386f2aa7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:31.542638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd090e1befb046f3875bf50e386f2aa7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:31.545364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd090e1befb046f3875bf50e386f2aa7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:31.545364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd090e1befb046f3875bf50e386f2aa7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:31.569662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1039/2058] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:18:31 2022] DELETE /identity/v3/users/fd090e1befb046f3875bf50e386f2aa7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:31.573167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f4de-0d53-4de0-ae72-14acd720dea1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:31.573743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f4de-0d53-4de0-ae72-14acd720dea1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:31.573848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822f4de-0d53-4de0-ae72-14acd720dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:31.599965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-e822f4de-0d53-4de0-ae72-14acd720dea1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:31.601488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e822f4de-0d53-4de0-ae72-14acd720dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:31.679415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1020/2059] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:31.690562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:31.692295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:31.779664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d5b2b-3c09-45f6-9639-3bf5044dbd81 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:31.786750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:31.787610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:31.788054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:31.788411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:31.811990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:31.813903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:31.842848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1040/2060] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:32.035510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ec69-b001-4ba0-afa1-e69b46616d5e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:32.036029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ec69-b001-4ba0-afa1-e69b46616d5e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:32.036532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ec69-b001-4ba0-afa1-e69b46616d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:32.104734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2cc1ec69-b001-4ba0-afa1-e69b46616d5e None None] MFA Rules not processed for user `51cf5070eaa549cfa05bcf76848b545b`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:32.108488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2cc1ec69-b001-4ba0-afa1-e69b46616d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:32.255861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1021/2061] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:32.570401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:32.572553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:32.608757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb926f0-f860-4b81-87ab-7ab93e992858 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:32.619270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:32.621187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:32.621754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:32.622311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] PATH_INFO: `/v3/projects/936b8789b955411ba7f665d1b49b60f4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:32.625743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936b8789b955411ba7f665d1b49b60f4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:32.627921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:32.695758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936b8789b955411ba7f665d1b49b60f4', 'request_id': 'req-000ff7f1-ad4c-4aae-975c-a5a23079fed2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:32.708928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936b8789b955411ba7f665d1b49b60f4', 'request_id': 'req-000ff7f1-ad4c-4aae-975c-a5a23079fed2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:32.720804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936b8789b955411ba7f665d1b49b60f4', 'request_id': 'req-000ff7f1-ad4c-4aae-975c-a5a23079fed2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:32.739031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] The token cache is being invalidate because project 936b8789b955411ba7f665d1b49b60f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:18:32.739341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:32.740019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-000ff7f1-ad4c-4aae-975c-a5a23079fed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:32.741810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1041/2062] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:18:32 2022] DELETE /identity/v3/projects/936b8789b955411ba7f665d1b49b60f4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:32.747694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c438-60eb-4455-be89-897b428c3826 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:32.748307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c438-60eb-4455-be89-897b428c3826 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:32.748756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c438-60eb-4455-be89-897b428c3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:32.779880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5699c438-60eb-4455-be89-897b428c3826 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:32.781799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5699c438-60eb-4455-be89-897b428c3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:32.861091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1022/2063] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:32.872238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:32.872462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:32.873509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:32.905722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:32.907161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:32.918553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1042/2064] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:32.922622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c438-60eb-4455-be89-897b428c3826 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:32.936454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c438-60eb-4455-be89-897b428c3826 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:32.947121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:32.948101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:32.948442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:32.948717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:32.949452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:18:32.949752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:32.951539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:32.965000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1023/2065] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:18:32.969598 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:32.982204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f8078-a920-4c6d-b6af-fef511169fd0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:32.987369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:32.988033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:32.988311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:32.988578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:32.989388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:32.992062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:33.041808 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1043/2066] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:18:32 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:33.045824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:33.061770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9405-82cc-4a17-b4e0-34f40c8ff728 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:33.134626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:33.135463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:33.135853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:33.136415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:33.137384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:33.139637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:33.169104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1024/2067] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:18:33 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:33.170649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:33.182428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb39634-fb15-4038-84d0-898b5f852da4 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:33.190775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:33.191669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:33.191946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:33.192254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:33.192984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:33.194742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:33.210958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1044/2068] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:33.213392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:33.227419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1ad8-5adb-41e2-83b5-0f7d09e9ab43 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:33.238193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80266903-cd30-42dd-907e-0fa9af3fe325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:33.239390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80266903-cd30-42dd-907e-0fa9af3fe325 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:33.239980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80266903-cd30-42dd-907e-0fa9af3fe325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:33.240680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80266903-cd30-42dd-907e-0fa9af3fe325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:33.241831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80266903-cd30-42dd-907e-0fa9af3fe325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:33.244175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80266903-cd30-42dd-907e-0fa9af3fe325 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:33.260753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1025/2069] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:33.262393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:33.274367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793edeb-748a-4d87-88cb-a602fd04387d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:33.289141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:33.290665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:33.291050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:33.291432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] PATH_INFO: `/v3/projects/f62edba9a4f9457c82909ceed58104c3/users/e74effe5c01e4e0e87650d0dc97b8e0b/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:33.315377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62edba9a4f9457c82909ceed58104c3, user_id=e74effe5c01e4e0e87650d0dc97b8e0b, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:33.319128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:33.346326 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1045/2070] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:18:33 2022] PUT /identity/v3/projects/f62edba9a4f9457c82909ceed58104c3/users/e74effe5c01e4e0e87650d0dc97b8e0b/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:33.348680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c010e-120e-4071-ad64-fad024da319f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:33.349058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c010e-120e-4071-ad64-fad024da319f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:33.349386 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c010e-120e-4071-ad64-fad024da319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:33.371732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-bc7c010e-120e-4071-ad64-fad024da319f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:33.373453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bc7c010e-120e-4071-ad64-fad024da319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:33.529205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1026/2071] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:18:33.538704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:33.542838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:33.688380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce1b2-328e-4018-ad80-d28591cce043 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:33.695390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cc7a5-ca8a-44d1-84df-a9a73151ee86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:33.696245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc7a5-ca8a-44d1-84df-a9a73151ee86 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:33.696618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc7a5-ca8a-44d1-84df-a9a73151ee86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:33.697069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cc7a5-ca8a-44d1-84df-a9a73151ee86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:33.714253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cc7a5-ca8a-44d1-84df-a9a73151ee86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:33.716016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cc7a5-ca8a-44d1-84df-a9a73151ee86 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:33.729165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1046/2072] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:41.085063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:41.085625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:41.085625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:41.125026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] MFA Rules not processed for user `090f701bb7e54a72ab9a5c84fba01fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:41.126380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:41.299949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1027/2073] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:42.605678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:42.605678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:42.605678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:42.697060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] MFA Rules not processed for user `e74effe5c01e4e0e87650d0dc97b8e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:42.698452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:42.874207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1047/2074] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:42.878762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:42.895305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4674bba-9ad7-4a6d-b4ee-f8f817a6e232 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:42.914635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:42.915363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:42.915641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:42.915908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:42.916614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:42.918760 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:42.996592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1028/2075] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:18:42 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:43.000906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:43.019650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5ef5-2a1d-463f-a974-b367ba36239c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:43.128673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:43.129629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:43.129969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:43.130478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:43.131452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:43.135159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:43.170810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1048/2076] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:18:42 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:43.174578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:43.188008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c877b-538d-44e2-93dd-0cae09a3e8f1 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:43.194304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:43.195159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:43.195620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:43.196176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:43.197005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:43.198749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:43.225549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1029/2077] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:43.227088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:43.252033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d91c2-0a64-4937-8549-85403d3f4aca admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:43.280666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:43.280666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:43.280666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:43.280666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] PATH_INFO: `/v3/projects/b22a9c819c2f4500922f7a5c27ac60f4/users/a413a11fb0a74a03970fb2ad22390d15/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:43.302309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22a9c819c2f4500922f7a5c27ac60f4, user_id=a413a11fb0a74a03970fb2ad22390d15, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:43.306713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:43.333648 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1049/2078] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:18:43 2022] PUT /identity/v3/projects/b22a9c819c2f4500922f7a5c27ac60f4/users/a413a11fb0a74a03970fb2ad22390d15/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:43.337568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:43.349088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732fd00-1ebe-4854-899f-1946297a0608 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:43.485734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd531-c98a-4ecd-8b15-f36b51774594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:43.486288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd531-c98a-4ecd-8b15-f36b51774594 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:43.486474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd531-c98a-4ecd-8b15-f36b51774594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:43.486743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd531-c98a-4ecd-8b15-f36b51774594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:43.487537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd531-c98a-4ecd-8b15-f36b51774594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:43.489173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd531-c98a-4ecd-8b15-f36b51774594 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:43.506242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1030/2079] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:43.510232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:43.523364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68ad8d-99b8-4d36-ab96-9f32684d8cf6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:43.528579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:43.529704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:43.530828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:43.531418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] PATH_INFO: `/v3/projects/b22a9c819c2f4500922f7a5c27ac60f4/users/a413a11fb0a74a03970fb2ad22390d15/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:43.536743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22a9c819c2f4500922f7a5c27ac60f4, user_id=a413a11fb0a74a03970fb2ad22390d15, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:43.542607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:43.563574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1050/2080] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:18:43 2022] PUT /identity/v3/projects/b22a9c819c2f4500922f7a5c27ac60f4/users/a413a11fb0a74a03970fb2ad22390d15/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:49.129110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a58c-734f-48bc-836f-a49ce31dc2b7 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:49.130033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a58c-734f-48bc-836f-a49ce31dc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:49.130640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a58c-734f-48bc-836f-a49ce31dc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:49.181931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-db15a58c-734f-48bc-836f-a49ce31dc2b7 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:49.183480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-db15a58c-734f-48bc-836f-a49ce31dc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:49.319936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1031/2081] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 4 08:18:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:49.337725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:49.344053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:49.506355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32b839-f31d-4fde-b376-5fd0801d5e58 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:49.533536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:49.534351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:49.534633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:49.537462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:49.562933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:49.564563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:49.587258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1051/2082] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:18:50.334174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2ae8d-77b1-493d-adfa-1d01bf6f07d7 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:50.336405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2ae8d-77b1-493d-adfa-1d01bf6f07d7 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:50.336998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2ae8d-77b1-493d-adfa-1d01bf6f07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:50.412903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-64d2ae8d-77b1-493d-adfa-1d01bf6f07d7 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:50.416277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-64d2ae8d-77b1-493d-adfa-1d01bf6f07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:50.447569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1032/2083] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:18:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:50.455935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:50.475040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547030f-9b5e-404a-bb13-a7938c053971 service swift] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:50.483394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:50.484486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:50.485263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:50.486223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:50.491383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6b52-af29-4674-9829-2bd4c9bc8afc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:50.492254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6b52-af29-4674-9829-2bd4c9bc8afc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:50.492774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6b52-af29-4674-9829-2bd4c9bc8afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:50.525209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:50.532754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:50.541048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2f2b6b52-af29-4674-9829-2bd4c9bc8afc None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:50.543543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2f2b6b52-af29-4674-9829-2bd4c9bc8afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:50.557491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1052/2084] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 08:18:50.561001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1033/2085] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:18:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:50.585392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:50.627686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c887f-d5f9-4809-9e09-1734d7b32756 service swift] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:50.644505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:50.648006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:50.649365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:50.651194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:50.674722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:50.680724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:50.735550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1053/2086] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:18:51.861296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908d3a-99c9-4b1d-a7ed-0d5dca9acf27 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:51.861871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908d3a-99c9-4b1d-a7ed-0d5dca9acf27 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:51.861871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2908d3a-99c9-4b1d-a7ed-0d5dca9acf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:51.903660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c2908d3a-99c9-4b1d-a7ed-0d5dca9acf27 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:51.907890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c2908d3a-99c9-4b1d-a7ed-0d5dca9acf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:51.934125 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1034/2087] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 4 08:18:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:51.938905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:51.985295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d786c37-b019-4252-be91-cf3c9f24ca7e service swift] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:52.044840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:52.045891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:52.046178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:52.046457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:52.073899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:52.081998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:52.120981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1054/2088] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:18:52.662154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:52.662737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:52.663188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:52.699516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:52.701999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:52.720174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1035/2089] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:18:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:52.737424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:52.753917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610429c4-3821-4f7c-89f1-697b62378dc4 service swift] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:52.764228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70c933-924d-40c0-9cc8-c4ed1db43d15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:52.765164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c933-924d-40c0-9cc8-c4ed1db43d15 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:52.765605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c933-924d-40c0-9cc8-c4ed1db43d15 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:52.766037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70c933-924d-40c0-9cc8-c4ed1db43d15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:52.799333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70c933-924d-40c0-9cc8-c4ed1db43d15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:52.805338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70c933-924d-40c0-9cc8-c4ed1db43d15 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:52.829764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1055/2090] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:18:53.387918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:53.390192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:53.598733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c60f4-e0cc-4e6e-b215-8ee35d62a268 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:53.608623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:53.609691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:53.610152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:53.610581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] PATH_INFO: `/v3/users/d334f02fca0a4a39914c4b7fdf1f93af` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:53.611987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d334f02fca0a4a39914c4b7fdf1f93af)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:53.614077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:53.745497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb30a8-8789-451e-8d00-b33055fcc20d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:53.746434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb30a8-8789-451e-8d00-b33055fcc20d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:53.746938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb30a8-8789-451e-8d00-b33055fcc20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:53.754871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd334f02fca0a4a39914c4b7fdf1f93af'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:53.770392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd334f02fca0a4a39914c4b7fdf1f93af'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:53.786658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd334f02fca0a4a39914c4b7fdf1f93af'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:53.788669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd334f02fca0a4a39914c4b7fdf1f93af'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:53.814875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd334f02fca0a4a39914c4b7fdf1f93af'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:53.822254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3abb30a8-8789-451e-8d00-b33055fcc20d None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:53.823949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3abb30a8-8789-451e-8d00-b33055fcc20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:53.830784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1036/2091] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:18:53 2022] DELETE /identity/v3/users/d334f02fca0a4a39914c4b7fdf1f93af => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:53.974111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1056/2092] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 4 08:18:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:53.983558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:53.999270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.069296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.069793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.070287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.146520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] MFA Rules not processed for user `a413a11fb0a74a03970fb2ad22390d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:54.147939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.262399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61360d1d-b2c5-4a0f-93ef-a57e2fb97b16 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:54.277480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beaa2e-d407-428f-b619-cac39a4e9b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:54.278553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beaa2e-d407-428f-b619-cac39a4e9b78 service swift] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.279031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beaa2e-d407-428f-b619-cac39a4e9b78 service swift] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.279463 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beaa2e-d407-428f-b619-cac39a4e9b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.295506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1057/2093] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:18:54.295506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:54.295506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.320773 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beaa2e-d407-428f-b619-cac39a4e9b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:54.327723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beaa2e-d407-428f-b619-cac39a4e9b78 service swift] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:54.355781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1037/2094] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 08:18:54.394380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532524c-e911-4fc7-8e13-d40b3658adaf None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:54.411737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:54.412869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.413153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.413419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] PATH_INFO: `/v3/projects/463813efb0b4415eb5e7863aa0f1f8a9` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.414804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=463813efb0b4415eb5e7863aa0f1f8a9)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:54.417820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:54.541070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463813efb0b4415eb5e7863aa0f1f8a9', 'request_id': 'req-afc39d1a-f90f-41a4-b0fc-57235ab40e54'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:54.553221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463813efb0b4415eb5e7863aa0f1f8a9', 'request_id': 'req-afc39d1a-f90f-41a4-b0fc-57235ab40e54'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:54.568463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463813efb0b4415eb5e7863aa0f1f8a9', 'request_id': 'req-afc39d1a-f90f-41a4-b0fc-57235ab40e54'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:54.584086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] The token cache is being invalidate because project 463813efb0b4415eb5e7863aa0f1f8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:18:54.584540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:54.586395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:54.588662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1058/2095] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:18:54 2022] DELETE /identity/v3/projects/463813efb0b4415eb5e7863aa0f1f8a9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:54.597258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403a85-019c-4c94-894e-f9fb18ac2dc9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.597258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403a85-019c-4c94-894e-f9fb18ac2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.597258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa403a85-019c-4c94-894e-f9fb18ac2dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.609028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:54.612652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.645725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fa403a85-019c-4c94-894e-f9fb18ac2dc9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:54.647430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fa403a85-019c-4c94-894e-f9fb18ac2dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.839018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1038/2096] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:54.862592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25525bff-3968-475d-9608-38dd9699417f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.863086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25525bff-3968-475d-9608-38dd9699417f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.863496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25525bff-3968-475d-9608-38dd9699417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.876067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc39d1a-f90f-41a4-b0fc-57235ab40e54 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:54.887647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:54.888629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.889061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.889472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.892177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.912974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-25525bff-3968-475d-9608-38dd9699417f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:54.914343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-25525bff-3968-475d-9608-38dd9699417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:54.934041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1039/2097] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:54.939582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25525bff-3968-475d-9608-38dd9699417f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:54.976578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25525bff-3968-475d-9608-38dd9699417f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:54.990617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:54.992842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:54.993701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:54.994115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:54.995029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:18:54.995541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:54.997500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.025310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:55.027531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.032471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1040/2098] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:18:55.037436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.039402 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1059/2099] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:55.057825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb006e-c1a4-4d4b-a5ae-27c5036d4755 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:55.063248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862d0cf-210d-4303-b5e5-e07294cd7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:55.064100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d0cf-210d-4303-b5e5-e07294cd7c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.064564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d0cf-210d-4303-b5e5-e07294cd7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.065083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862d0cf-210d-4303-b5e5-e07294cd7c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.065928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862d0cf-210d-4303-b5e5-e07294cd7c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:55.068548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862d0cf-210d-4303-b5e5-e07294cd7c80 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.165205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1041/2100] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:18:55 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:55.225445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.246809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19d255-031d-4f62-aa8a-be843ee1dea0 service glance] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:55.366098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13374-635d-44d5-81a8-45264139004c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.366579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13374-635d-44d5-81a8-45264139004c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.366951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13374-635d-44d5-81a8-45264139004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.404006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-28f13374-635d-44d5-81a8-45264139004c None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:55.405577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-28f13374-635d-44d5-81a8-45264139004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:55.451912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:55.452601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.452880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.453149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.453839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:55.455816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.508638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1060/2101] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:18:55 2022] POST /identity/v3/users => generated 282 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:55.511845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.534445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ef807-68f3-4f6a-bb97-559cd5804a8e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:55.542187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:55.543179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.543624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.544256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1042/2102] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:18:55.544570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.545534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:55.547462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.561767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1061/2103] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:18:55.565868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13374-635d-44d5-81a8-45264139004c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.568442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.576350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:55.603313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13374-635d-44d5-81a8-45264139004c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:55.613265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:55.614547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.614547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.614547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.616614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:55.620119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.649656 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1043/2104] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:18:55.651709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.689474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fdee0-1c8c-4bc9-acb8-ac138aef49be admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:55.709965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179de1e-0f76-4339-9e93-68e131054e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:55.711274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179de1e-0f76-4339-9e93-68e131054e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.711715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179de1e-0f76-4339-9e93-68e131054e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.712361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179de1e-0f76-4339-9e93-68e131054e38 admin admin] PATH_INFO: `/v3/projects/594e2f3f973948fb8dbbfdc8dff02dd9/users/e18b9fdc4fa64b82bfb722011693cb48/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.758114 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179de1e-0f76-4339-9e93-68e131054e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594e2f3f973948fb8dbbfdc8dff02dd9, user_id=e18b9fdc4fa64b82bfb722011693cb48, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:55.762544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179de1e-0f76-4339-9e93-68e131054e38 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:55.797223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1044/2105] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:18:55 2022] PUT /identity/v3/projects/594e2f3f973948fb8dbbfdc8dff02dd9/users/e18b9fdc4fa64b82bfb722011693cb48/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:55.799255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.799703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.800138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.805201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f0c8d-87c3-4002-9402-9b9aa7d1e9a8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:55.868501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] MFA Rules not processed for user `e18b9fdc4fa64b82bfb722011693cb48`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:55.870472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:55.909581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:55.910428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:55.910715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:55.911148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:55.969641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1045/2106] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:55.980591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:55.984375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:56.042703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:56.044640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:56.059986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1062/2107] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:18:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:18:56.185611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc2e87-44d8-4f35-942e-f92a8a4fe18f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:56.193520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26648f9f-e968-4bd1-8fbd-394e67a36145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:56.194177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26648f9f-e968-4bd1-8fbd-394e67a36145 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:56.194458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26648f9f-e968-4bd1-8fbd-394e67a36145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:56.194733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26648f9f-e968-4bd1-8fbd-394e67a36145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:56.217846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26648f9f-e968-4bd1-8fbd-394e67a36145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:56.220836 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26648f9f-e968-4bd1-8fbd-394e67a36145 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:56.253022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1046/2108] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:57.499189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:57.502486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:57.688288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea8427-8271-44c8-8385-e1ec588b5433 service swift] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:57.701705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:57.702616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:57.702908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:57.703782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] PATH_INFO: `/v3/users/a15d386a74d645caaef2dac8250f9a92` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:57.705537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15d386a74d645caaef2dac8250f9a92)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:57.715098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:57.850692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15d386a74d645caaef2dac8250f9a92'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:57.875845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15d386a74d645caaef2dac8250f9a92'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:57.931482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15d386a74d645caaef2dac8250f9a92'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:57.939083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15d386a74d645caaef2dac8250f9a92'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:57.942268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15d386a74d645caaef2dac8250f9a92'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:58.017536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1063/2109] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:18:57 2022] DELETE /identity/v3/users/a15d386a74d645caaef2dac8250f9a92 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:58.022128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:58.022621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:58.022863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:58.094430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:58.098750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:58.223877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1047/2110] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:58.251396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:58.252553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:58.466857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443f559-e5f8-4f2a-b32e-5011f9617b5e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:58.491482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdcbb0-a192-44a7-9d09-d6fc957f2487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:58.492528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdcbb0-a192-44a7-9d09-d6fc957f2487 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:58.493079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdcbb0-a192-44a7-9d09-d6fc957f2487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:58.493479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdcbb0-a192-44a7-9d09-d6fc957f2487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:58.521541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdcbb0-a192-44a7-9d09-d6fc957f2487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:58.524008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdcbb0-a192-44a7-9d09-d6fc957f2487 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:58.547329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1064/2111] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:18:59.158256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:59.159716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:59.189702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257f173-23e4-4211-8abd-331249f7ef75 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:59.202938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:59.203841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:59.204119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:59.204388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] PATH_INFO: `/v3/projects/6ba19a2b064a49109c40d335ac3b1863` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:59.224164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba19a2b064a49109c40d335ac3b1863)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:59.227403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:59.335256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba19a2b064a49109c40d335ac3b1863', 'request_id': 'req-c11308eb-f864-4b62-9d94-8546d71b548d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:59.352644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba19a2b064a49109c40d335ac3b1863', 'request_id': 'req-c11308eb-f864-4b62-9d94-8546d71b548d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:59.365035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba19a2b064a49109c40d335ac3b1863', 'request_id': 'req-c11308eb-f864-4b62-9d94-8546d71b548d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:59.397367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] The token cache is being invalidate because project 6ba19a2b064a49109c40d335ac3b1863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:18:59.397953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:59.409250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11308eb-f864-4b62-9d94-8546d71b548d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:18:59.411319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1048/2112] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:18:59 2022] DELETE /identity/v3/projects/6ba19a2b064a49109c40d335ac3b1863 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:18:59.416610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:59.416900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:59.417179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:59.470414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:59.470414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:59.631848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1065/2113] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:59.640080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:59.640665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:59.641103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:59.685969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:18:59.693913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:18:59.715779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1049/2114] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:18:59.718856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:59.736871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48e6d9-a288-4441-8220-abf11a097c1c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:59.750953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:59.751640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:59.752934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:59.758212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:59.758856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:18:59.759147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:59.761413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:59.802532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1066/2115] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:18:59.807339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:59.816894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6a0b9-431e-4591-a646-509f73a442fe None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:18:59.860886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:18:59.861820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:18:59.862264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:18:59.862684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:18:59.863618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:18:59.875154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:18:59.951985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1050/2116] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:18:59.953764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:18:59.973079 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3636151-62d5-4e20-89e6-411d86dd8f75 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:00.254006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:00.254006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:00.254912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:00.254912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:00.255486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:00.257664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:00.303841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1067/2117] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:18:59 2022] POST /identity/v3/users => generated 287 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:19:00.305434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:00.317311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816756-fac7-4f35-a928-4d86bd8c1150 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:00.348367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:00.348985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:00.349399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:00.349714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:00.350409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:00.352058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:00.401551 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:00.407330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1051/2118] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:19:00.423614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6ce43-27b3-48d4-8bc4-4adb41be41b7 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:00.446396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7969a-25e6-43c2-901f-7d5ece5ae062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:00.447120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7969a-25e6-43c2-901f-7d5ece5ae062 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:00.447395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7969a-25e6-43c2-901f-7d5ece5ae062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:00.447667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7969a-25e6-43c2-901f-7d5ece5ae062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:00.448399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7969a-25e6-43c2-901f-7d5ece5ae062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:00.450701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7969a-25e6-43c2-901f-7d5ece5ae062 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:00.489903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:00.501010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff01d-4f94-4169-bc2d-94ed811b4cb6 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:00.510813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1068/2119] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:19:00.537095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:00.538018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:00.538324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:00.551167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] PATH_INFO: `/v3/projects/b207a35c92594e5e8b968a59a8509940/users/ef0437196a324c5881698cd001717b34/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:00.606371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b207a35c92594e5e8b968a59a8509940, user_id=ef0437196a324c5881698cd001717b34, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:00.612796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:00.656887 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1052/2120] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:19:00 2022] PUT /identity/v3/projects/b207a35c92594e5e8b968a59a8509940/users/ef0437196a324c5881698cd001717b34/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:19:00.668576 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb51f2a-37f5-471f-93dc-d60a92687042 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:00.669151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb51f2a-37f5-471f-93dc-d60a92687042 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:00.670411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb51f2a-37f5-471f-93dc-d60a92687042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:00.732556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9bb51f2a-37f5-471f-93dc-d60a92687042 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:00.733762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9bb51f2a-37f5-471f-93dc-d60a92687042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:00.930460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1069/2121] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:00.941308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:00.943120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:01.093865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca15dde-604c-4c94-9e4c-b299c8648ec7 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:01.109600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:01.110275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:01.110550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:01.110811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:01.157893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:01.159405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:01.212023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1053/2122] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:19:13.063062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.067823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.068265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.122980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] MFA Rules not processed for user `ef0437196a324c5881698cd001717b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:13.124345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:13.258786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:13.269133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4ca5c-493c-4a8a-aee6-e9662f1c59b3 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:13.269746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1070/2123] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:13.274793 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:13.275701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.276140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.276576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.277422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:13.280578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:13.325307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1054/2124] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:19:13 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:19:13.329287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:13.351943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ace7f-2bfb-485d-ab3f-06891979847b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:13.463675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:13.464471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.464915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.465346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.466196 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:13.468162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:13.495381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1071/2125] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:19:13 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:19:13.499093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:13.510189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d53c-ca1d-42e1-984a-5c726c848bdb admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:13.515618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:13.516310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.516587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.516854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.517601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:13.519219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:13.535579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1055/2126] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:19:13.539402 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:13.552546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd7d0-717f-4f01-adbd-f7c08a2a873e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:13.561840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:13.563391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.563800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.564688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] PATH_INFO: `/v3/projects/cb7e420ca5b7450b9d6fb094a5760af2/users/c1a0a98e9f97441e9e6d6a9acf05656c/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.592304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb7e420ca5b7450b9d6fb094a5760af2, user_id=c1a0a98e9f97441e9e6d6a9acf05656c, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:13.594621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:13.619517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1072/2127] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:19:13 2022] PUT /identity/v3/projects/cb7e420ca5b7450b9d6fb094a5760af2/users/c1a0a98e9f97441e9e6d6a9acf05656c/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:19:13.619977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:13.634327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c6448-768c-4708-ad1b-1b682cdb539e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:13.719068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2602-807a-4b02-a277-3e4beb4cd07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:13.720277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2602-807a-4b02-a277-3e4beb4cd07e admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.720893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2602-807a-4b02-a277-3e4beb4cd07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.721329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2602-807a-4b02-a277-3e4beb4cd07e admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.722288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2602-807a-4b02-a277-3e4beb4cd07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:13.724332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2602-807a-4b02-a277-3e4beb4cd07e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:13.741499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1056/2128] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:19:13.745064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:13.758209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f1b48-5f60-40bb-80cc-503ecffcd85b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:13.765505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:13.766756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:13.766756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:13.767147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] PATH_INFO: `/v3/projects/cb7e420ca5b7450b9d6fb094a5760af2/users/c1a0a98e9f97441e9e6d6a9acf05656c/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:13.779958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb7e420ca5b7450b9d6fb094a5760af2, user_id=c1a0a98e9f97441e9e6d6a9acf05656c, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:13.782836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:13.802670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1073/2129] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:19:13 2022] PUT /identity/v3/projects/cb7e420ca5b7450b9d6fb094a5760af2/users/c1a0a98e9f97441e9e6d6a9acf05656c/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:19:16.568061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752523bf-a90a-408c-915e-beae2ed684db None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:16.568569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752523bf-a90a-408c-915e-beae2ed684db None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:16.568782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752523bf-a90a-408c-915e-beae2ed684db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:16.590588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-752523bf-a90a-408c-915e-beae2ed684db None None] MFA Rules not processed for user `e74effe5c01e4e0e87650d0dc97b8e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:16.592565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-752523bf-a90a-408c-915e-beae2ed684db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:16.688576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1057/2130] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:19:17.175106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:17.177559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:17.312904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b065c8-bd04-4474-b1c1-80c50bb80989 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:17.319870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b99e7835d04098ad38e4eee401ea91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:17.320955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:17.321232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:17.321504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:17.323691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:17.335675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:17.337297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:17.347927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1074/2131] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:19.768666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb063d-094f-4bd3-b66f-811519b0d612 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:19.769992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb063d-094f-4bd3-b66f-811519b0d612 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:19.770500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb063d-094f-4bd3-b66f-811519b0d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:19.813360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d1cb063d-094f-4bd3-b66f-811519b0d612 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:19.814689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d1cb063d-094f-4bd3-b66f-811519b0d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:19.935148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1058/2132] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:19:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:19.966600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:19.968791 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:20.113617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd465f0-1397-4bca-9497-53652572d24e service placement] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:20.132022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47784ca-7c1d-42f4-b70c-edb7b1c06400 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:20.132923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47784ca-7c1d-42f4-b70c-edb7b1c06400 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:20.133330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47784ca-7c1d-42f4-b70c-edb7b1c06400 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:20.133574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47784ca-7c1d-42f4-b70c-edb7b1c06400 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:20.147930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47784ca-7c1d-42f4-b70c-edb7b1c06400 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:20.151210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47784ca-7c1d-42f4-b70c-edb7b1c06400 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:20.171543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1075/2133] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:19:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:19:20.374038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d089ca-bd59-4579-95fb-bb3d223847e5 None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:20.374333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d089ca-bd59-4579-95fb-bb3d223847e5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:20.374604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d089ca-bd59-4579-95fb-bb3d223847e5 None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:20.376277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1059/2134] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:19:20.410055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:20.410560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:20.411080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:20.618260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:20.620037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:20.919069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1076/2135] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:19:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:21.814306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aad0ab-98c3-442a-9ba4-400b4e27ab09 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:21.815624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aad0ab-98c3-442a-9ba4-400b4e27ab09 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:21.816529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aad0ab-98c3-442a-9ba4-400b4e27ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:21.899323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a2aad0ab-98c3-442a-9ba4-400b4e27ab09 None None] MFA Rules not processed for user `c1a0a98e9f97441e9e6d6a9acf05656c`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:21.900853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2aad0ab-98c3-442a-9ba4-400b4e27ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:22.016939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1060/2136] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:22.037178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:22.038599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:22.062572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe07b80-f511-4a87-8e30-5433e82b6178 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:22.075286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:22.075983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:22.076248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:22.076522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:22.255553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:22.266315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:22.299904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1077/2137] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:23.937377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953594c7-ed04-4973-bb6b-fdf9cc86ce2b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:23.938507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953594c7-ed04-4973-bb6b-fdf9cc86ce2b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:23.939084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953594c7-ed04-4973-bb6b-fdf9cc86ce2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:23.969867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-953594c7-ed04-4973-bb6b-fdf9cc86ce2b None None] MFA Rules not processed for user `ef0437196a324c5881698cd001717b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:23.971189 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-953594c7-ed04-4973-bb6b-fdf9cc86ce2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:23.980087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1061/2138] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:26.798818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:26.800396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:26.858767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471372fc-e2e3-499c-9b9b-70664cdb7df2 service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:26.862446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d929b-9228-46b3-aafb-4d8973f47d94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:26.863224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d929b-9228-46b3-aafb-4d8973f47d94 service glance] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:26.863410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d929b-9228-46b3-aafb-4d8973f47d94 service glance] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:26.863676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d929b-9228-46b3-aafb-4d8973f47d94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:26.874818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d929b-9228-46b3-aafb-4d8973f47d94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:26.876278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d929b-9228-46b3-aafb-4d8973f47d94 service glance] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:26.894758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1078/2139] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:26.987623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f0a3-dc9e-4b04-88be-16729a49f28b None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:26.988148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f0a3-dc9e-4b04-88be-16729a49f28b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:26.988342 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f0a3-dc9e-4b04-88be-16729a49f28b None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:26.989903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1062/2140] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:19:26.997227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb4abc-ea0c-494a-a178-c41b3c2d2112 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:26.997227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb4abc-ea0c-494a-a178-c41b3c2d2112 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:26.997227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb4abc-ea0c-494a-a178-c41b3c2d2112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:27.017669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c0fb4abc-ea0c-494a-a178-c41b3c2d2112 None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:27.018995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c0fb4abc-ea0c-494a-a178-c41b3c2d2112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:27.101749 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1079/2141] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:19:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:27.121447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f0a3-dc9e-4b04-88be-16729a49f28b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:27.123869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6052f0a3-dc9e-4b04-88be-16729a49f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:27.152388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f0a3-dc9e-4b04-88be-16729a49f28b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:27.158284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2de7e-7810-45db-b4b6-10f69e507314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:27.159404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2de7e-7810-45db-b4b6-10f69e507314 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:27.159915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2de7e-7810-45db-b4b6-10f69e507314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:27.160413 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2de7e-7810-45db-b4b6-10f69e507314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:27.171795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2de7e-7810-45db-b4b6-10f69e507314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:27.174631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2de7e-7810-45db-b4b6-10f69e507314 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:27.187289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1063/2142] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:27.355695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38a64-bdc0-47eb-82b3-45ff56b11c6a None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:27.356240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38a64-bdc0-47eb-82b3-45ff56b11c6a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:27.356733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a38a64-bdc0-47eb-82b3-45ff56b11c6a None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:27.358626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1080/2143] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:19:27.381888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dacf1-b24b-4ecb-877a-7e996994d86b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:27.382462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dacf1-b24b-4ecb-877a-7e996994d86b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:27.383084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dacf1-b24b-4ecb-877a-7e996994d86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:27.446493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-cb8dacf1-b24b-4ecb-877a-7e996994d86b None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:27.449132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cb8dacf1-b24b-4ecb-877a-7e996994d86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:27.471041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1064/2144] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:19:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:27.496460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a38a64-bdc0-47eb-82b3-45ff56b11c6a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:27.512020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a38a64-bdc0-47eb-82b3-45ff56b11c6a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:27.531537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:27.533383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:27.536033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:27.536601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:27.581320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:27.585692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:27.629076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1081/2145] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:36.200757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:36.201273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:36.201390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:36.219469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:36.220642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:36.229003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1065/2146] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:36.241239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:36.253302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ddfab-1b5b-49d3-ba92-0209f9317db6 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:36.259416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1a33e-17ac-4eaa-bfd3-e9391e690807 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:36.260073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a33e-17ac-4eaa-bfd3-e9391e690807 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:36.260352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a33e-17ac-4eaa-bfd3-e9391e690807 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:36.260621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1a33e-17ac-4eaa-bfd3-e9391e690807 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:36.270178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1a33e-17ac-4eaa-bfd3-e9391e690807 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:36.271937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1a33e-17ac-4eaa-bfd3-e9391e690807 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:36.280776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1082/2147] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:19:39.202481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:39.204106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:39.293362 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e49be-1d74-4c75-8af0-e6a95871c436 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:39.298694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:39.299895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:39.300289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:39.300658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] PATH_INFO: `/v3/users/e18b9fdc4fa64b82bfb722011693cb48` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:39.302202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18b9fdc4fa64b82bfb722011693cb48)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:39.304794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:39.367522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18b9fdc4fa64b82bfb722011693cb48'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:39.377781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18b9fdc4fa64b82bfb722011693cb48'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:39.389152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18b9fdc4fa64b82bfb722011693cb48'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:39.389931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18b9fdc4fa64b82bfb722011693cb48'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:39.407979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18b9fdc4fa64b82bfb722011693cb48'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:39.414604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1066/2148] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:19:39 2022] DELETE /identity/v3/users/e18b9fdc4fa64b82bfb722011693cb48 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:19:39.419299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:39.419854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:39.420089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:39.448433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:39.449652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:39.517787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1083/2149] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:39.527605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:39.529033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:39.590317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8122e-e739-4ab0-bf1f-6a04b50d31a4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:39.595598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c122f79-e751-408d-9140-18b25e0c6885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:39.596267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122f79-e751-408d-9140-18b25e0c6885 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:39.596543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122f79-e751-408d-9140-18b25e0c6885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:39.596817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122f79-e751-408d-9140-18b25e0c6885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:39.606528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122f79-e751-408d-9140-18b25e0c6885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:39.608109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122f79-e751-408d-9140-18b25e0c6885 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:39.618514 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1067/2150] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:39.909809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:39.911501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:39.923926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d590-f269-46e5-be0d-75f75dc9b82e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:39.932272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:39.933440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:39.935124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:39.935432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] PATH_INFO: `/v3/projects/594e2f3f973948fb8dbbfdc8dff02dd9` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:39.936708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594e2f3f973948fb8dbbfdc8dff02dd9)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:39.938636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:39.991500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594e2f3f973948fb8dbbfdc8dff02dd9', 'request_id': 'req-b24dfd5c-44c3-4731-a695-75bb31c04f10'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:40.000247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594e2f3f973948fb8dbbfdc8dff02dd9', 'request_id': 'req-b24dfd5c-44c3-4731-a695-75bb31c04f10'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:40.006720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594e2f3f973948fb8dbbfdc8dff02dd9', 'request_id': 'req-b24dfd5c-44c3-4731-a695-75bb31c04f10'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:40.016584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] The token cache is being invalidate because project 594e2f3f973948fb8dbbfdc8dff02dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:19:40.016870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:40.017496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b24dfd5c-44c3-4731-a695-75bb31c04f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:40.019090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1084/2151] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:19:39 2022] DELETE /identity/v3/projects/594e2f3f973948fb8dbbfdc8dff02dd9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:19:40.024118 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.024471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.024809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.048410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:40.050093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:40.109749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1068/2152] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:19:40.118238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.118535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.118827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.139061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:40.140267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:40.148387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1085/2153] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:40.155628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.166862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00427f-86e1-43e7-a24e-a13dd8d086e1 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.173739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.174526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.174863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.175220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.176073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:19:40.176435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.178089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.194517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1069/2154] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:19:40.197939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.212316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9907-0090-45b5-9b07-2ae98b3fa3cf None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.217281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.217946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.218230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.218843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.219369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.221989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.275361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1086/2155] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:19:40 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:19:40.275600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.307173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b5a1d-475b-428e-afca-c2b7556cfc38 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.379158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.379996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.380395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.380734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.381500 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.393604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.406933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1070/2156] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:19:40 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:19:40.410997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.425798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068d3a-05e8-4304-9644-dba818cb4f36 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.430815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.431513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.431792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.432063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.432827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.434431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.445832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1087/2157] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:19:40.449938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.463493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa92bd1-2fd0-4f34-a814-e8b61a9bb68a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.468586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267d9f8-4d77-445b-95ec-3f2fc1c088f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.469371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d9f8-4d77-445b-95ec-3f2fc1c088f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.469735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d9f8-4d77-445b-95ec-3f2fc1c088f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.470104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267d9f8-4d77-445b-95ec-3f2fc1c088f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.470941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d9f8-4d77-445b-95ec-3f2fc1c088f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.472762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267d9f8-4d77-445b-95ec-3f2fc1c088f5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.491832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1071/2158] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:19:40.495982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.506455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078010a-5e78-46b6-8147-2003ad999e83 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.511203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.512019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.512294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.512657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] PATH_INFO: `/v3/projects/44480356064746a1be09beb4a3088e4c/users/f1e659205ff34a24a95b80ac5a5e218a/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.532094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44480356064746a1be09beb4a3088e4c, user_id=f1e659205ff34a24a95b80ac5a5e218a, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.535064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.556194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1088/2159] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:19:40 2022] PUT /identity/v3/projects/44480356064746a1be09beb4a3088e4c/users/f1e659205ff34a24a95b80ac5a5e218a/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:19:40.566862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.567171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.567443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.609801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] MFA Rules not processed for user `f1e659205ff34a24a95b80ac5a5e218a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:40.611425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:40.711006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1072/2160] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:40.728943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.730657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:40.800591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323a0b-51fe-4b42-b4e4-ef69d66151f6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.804712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1344d-c029-46ca-9ee4-e69a889d2ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.805374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1344d-c029-46ca-9ee4-e69a889d2ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.805656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1344d-c029-46ca-9ee4-e69a889d2ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.805930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1344d-c029-46ca-9ee4-e69a889d2ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.815286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1344d-c029-46ca-9ee4-e69a889d2ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.816948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1344d-c029-46ca-9ee4-e69a889d2ea1 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.827428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1089/2161] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:40.853807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:40.920482 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49288-5393-4a92-b19b-9e88dc1d7598 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:40.925132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:40.926077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:40.926347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:40.926613 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] PATH_INFO: `/v3/users/f1e659205ff34a24a95b80ac5a5e218a` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:40.928005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e659205ff34a24a95b80ac5a5e218a)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:40.930274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:40.987630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e659205ff34a24a95b80ac5a5e218a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:40.999964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e659205ff34a24a95b80ac5a5e218a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.007861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e659205ff34a24a95b80ac5a5e218a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.008662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e659205ff34a24a95b80ac5a5e218a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.036727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e659205ff34a24a95b80ac5a5e218a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.043704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1073/2162] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:19:40 2022] DELETE /identity/v3/users/f1e659205ff34a24a95b80ac5a5e218a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:19:41.048378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:41.048728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:41.049069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:41.069242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:19:41.070800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:41.137392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1090/2163] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:19:41.144882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:41.146616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:41.204434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf41731-2aca-46f9-9f0e-076da6e9c6fe admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:41.208366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e90d7-7c25-4f11-a758-5a7ef0707e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:41.209044 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e90d7-7c25-4f11-a758-5a7ef0707e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:41.209324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e90d7-7c25-4f11-a758-5a7ef0707e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:41.209622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e90d7-7c25-4f11-a758-5a7ef0707e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:41.219513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e90d7-7c25-4f11-a758-5a7ef0707e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:41.220964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e90d7-7c25-4f11-a758-5a7ef0707e2a service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:41.230997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1074/2164] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:19:41.565276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:19:41.566972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:19:41.581486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc761f3b-c0e4-4271-9d69-6713b5a52889 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:19:41.591049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:19:41.599255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:19:41.601258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:19:41.604570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] PATH_INFO: `/v3/projects/44480356064746a1be09beb4a3088e4c` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:19:41.604570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44480356064746a1be09beb4a3088e4c)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:19:41.607853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:19:41.677294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44480356064746a1be09beb4a3088e4c', 'request_id': 'req-5d2a4d05-62b2-483b-a991-441483d5e158'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.685590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44480356064746a1be09beb4a3088e4c', 'request_id': 'req-5d2a4d05-62b2-483b-a991-441483d5e158'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.695904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44480356064746a1be09beb4a3088e4c', 'request_id': 'req-5d2a4d05-62b2-483b-a991-441483d5e158'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.709474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] The token cache is being invalidate because project 44480356064746a1be09beb4a3088e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:19:41.709844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.710556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:19:41.714736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1091/2165] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:19:41 2022] DELETE /identity/v3/projects/44480356064746a1be09beb4a3088e4c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:20:01.567804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:01.568915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:01.569401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:01.589488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:20:01.590794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:01.648812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1075/2166] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 4 08:20:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:20:01.662385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:20:01.664459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:01.734371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4d05-62b2-483b-a991-441483d5e158 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:20:01.739691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:20:01.740343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:01.740625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:01.740897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:01.749055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:20:01.750866 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:20:01.758917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1092/2167] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:20:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:20:06.161236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:20:06.162749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:06.220918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed635a-bab7-4ee2-a8c4-0224c194ba52 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:20:06.227076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:20:06.227727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:06.228002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:06.228291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:06.230720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:06.297448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:20:06.299024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46b76-815a-4a26-9ca4-845306988f6c service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:20:06.309303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1076/2168] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:20:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:20:12.581688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:20:12.591010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0fb61-e15c-4e23-b234-89c95904a547 service swift] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:20:12.594497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:20:12.595162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:12.595445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:12.595717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:12.597481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:12.670640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:20:12.672120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9feda-12c8-4b08-b3ae-15781748cc2c service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:20:12.682574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1093/2169] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:20:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:20:16.837149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00535e0e-1572-4f49-bdc7-4b9fe11a0e3e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:16.837694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00535e0e-1572-4f49-bdc7-4b9fe11a0e3e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:16.837694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00535e0e-1572-4f49-bdc7-4b9fe11a0e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:16.855955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-00535e0e-1572-4f49-bdc7-4b9fe11a0e3e None None] MFA Rules not processed for user `090f701bb7e54a72ab9a5c84fba01fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:20:16.857153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-00535e0e-1572-4f49-bdc7-4b9fe11a0e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:16.917304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1077/2170] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:20:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:20:19.636207 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:19.636783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:19.636783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:19.654469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] MFA Rules not processed for user `51cf5070eaa549cfa05bcf76848b545b`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:20:19.655698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:19.721983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1094/2171] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:20:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:20:32.671706 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06d39-cd69-4f76-98ec-b083fc9411f6 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:20:32.672677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06d39-cd69-4f76-98ec-b083fc9411f6 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:20:32.673025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d06d39-cd69-4f76-98ec-b083fc9411f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:20:32.691338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-f5d06d39-cd69-4f76-98ec-b083fc9411f6 None None] MFA Rules not processed for user `599e6fd88ed348eab5de9a6330daf477`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:20:32.692675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f5d06d39-cd69-4f76-98ec-b083fc9411f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:20:32.750001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1078/2172] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:20:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:00.216199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:00.226038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3843c1-9060-417d-9345-210b7c857ceb None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:00.229704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:00.230369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:00.230695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:00.230976 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:00.232962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:00.305611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:00.307108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:00.319459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1095/2173] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:02.211527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:02.212053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:02.212053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:02.230608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] MFA Rules not processed for user `9fe1a122817249d59ce515f6651f1c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:02.231851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:02.288105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1079/2174] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:02.323993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:02.325428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:02.384106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd2da-86b6-4799-8cf5-1036f659b522 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:02.389779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:02.390436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:02.390717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:02.391263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:02.393485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:02.410442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:02.412244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:02.423765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1096/2175] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:13.914120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:13.915778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:13.979927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c02903-119d-45f9-8812-050dd33f3674 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:13.984291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:13.984914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:13.985208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:13.985477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:13.987602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:13.999002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:14.000414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:14.009475 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1080/2176] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:20.614370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:20.616359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:20.628743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25a258-3374-4b42-9aea-c3c673295269 service glance] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:20.633340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:20.634267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:20.634543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:20.634805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:20.636863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:20.646530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:20.647997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:20.656155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1097/2177] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:30.729636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:30.731357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:30.748134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112d17f-7720-4858-9c3d-e278ce8aab58 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:30.754785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:30.755470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:30.755746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:30.756063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:30.757933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:30.768877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:30.770457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:30.779479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1081/2178] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:36.020677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:36.022289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:36.035126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135c3ad-ff34-4d90-9817-ebd4b224274f service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:36.039123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:36.039847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:36.040192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:36.040524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:36.044105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:36.105657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:36.107243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:36.119507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1098/2179] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:38.627414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:38.638557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072e08-0775-4122-aec0-2a610d4e2874 service nova] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:38.642345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:38.643042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:38.643323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:38.643602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:38.645487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:38.709136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:38.710546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:38.720777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1082/2180] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:43.297030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:43.299226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:43.318758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7588b5-70a2-4eef-a875-741360408b52 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:43.323818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:43.324773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:43.325050 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:43.325503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] PATH_INFO: `/v3/users/51cf5070eaa549cfa05bcf76848b545b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:43.326758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cf5070eaa549cfa05bcf76848b545b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:43.328846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:43.378584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cf5070eaa549cfa05bcf76848b545b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.391461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cf5070eaa549cfa05bcf76848b545b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.398699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cf5070eaa549cfa05bcf76848b545b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.399394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cf5070eaa549cfa05bcf76848b545b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.400008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-04cf2a79-b2cf-4c66-8f2d-35fc348e726b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cf5070eaa549cfa05bcf76848b545b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.419409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1099/2181] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:21:43 2022] DELETE /identity/v3/users/51cf5070eaa549cfa05bcf76848b545b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:43.593065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:43.604605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043658-b298-4840-8334-c42446b87863 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:43.664652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:43.665526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:43.665802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:43.666440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] PATH_INFO: `/v3/projects/627a6ec20d314e7ba545b36a7e9b2fe8` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:43.667810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627a6ec20d314e7ba545b36a7e9b2fe8)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:43.669724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:43.715527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627a6ec20d314e7ba545b36a7e9b2fe8', 'request_id': 'req-8be37654-8f25-4348-b8c5-8f464dd97e19'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.721833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627a6ec20d314e7ba545b36a7e9b2fe8', 'request_id': 'req-8be37654-8f25-4348-b8c5-8f464dd97e19'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.729241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627a6ec20d314e7ba545b36a7e9b2fe8', 'request_id': 'req-8be37654-8f25-4348-b8c5-8f464dd97e19'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.740049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] The token cache is being invalidate because project 627a6ec20d314e7ba545b36a7e9b2fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:21:43.740305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.740988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8be37654-8f25-4348-b8c5-8f464dd97e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:43.742566 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1083/2182] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:21:43 2022] DELETE /identity/v3/projects/627a6ec20d314e7ba545b36a7e9b2fe8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:43.747644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:43.747905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:43.748179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:43.768376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:43.769643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:43.840368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1100/2183] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:43.848212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:43.848599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:43.848941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:43.867352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:43.868766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:43.877076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1084/2184] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:43.881377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:43.893151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf5e1b-8a76-41f2-80ee-dbb112bdd11c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:43.898198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:43.899238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:43.900025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:43.900410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:43.901526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:21:43.902141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:43.904147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:43.918364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1101/2185] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:21:43.923554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:43.933398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d6657-6de1-41ed-97ee-b81a4f0f4d3d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:43.938824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e1cf2-a53e-4b0b-9c10-15fc132c840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:43.939528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e1cf2-a53e-4b0b-9c10-15fc132c840c admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:43.939813 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e1cf2-a53e-4b0b-9c10-15fc132c840c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:43.940080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e1cf2-a53e-4b0b-9c10-15fc132c840c admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:43.940789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e1cf2-a53e-4b0b-9c10-15fc132c840c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:43.942724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e1cf2-a53e-4b0b-9c10-15fc132c840c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:43.973717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1085/2186] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:21:43 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:43.975498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:43.986058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f27d9a-23dd-4526-89a0-fda52a786e61 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.036876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.037223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.037501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.044939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.045730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.046072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.046348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.047089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.049075 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.057816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] MFA Rules not processed for user `2112f845ab0347b099ead44c05a71785`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:44.059140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:44.070472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1102/2187] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:21:43 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:44.074694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.084554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df81868-c880-404a-bf79-6d50dfc78f5f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.090378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.091020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.091325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.091621 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.092309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.093983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.104215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1103/2188] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:21:44.107989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.119319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1086/2189] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:44.121370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dc6e-5546-4254-ba7a-6997dbf111b9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.126345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f2e44-afb3-41af-811a-1dc60e1f4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.127088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f2e44-afb3-41af-811a-1dc60e1f4006 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.127369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f2e44-afb3-41af-811a-1dc60e1f4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.127636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f2e44-afb3-41af-811a-1dc60e1f4006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.128356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f2e44-afb3-41af-811a-1dc60e1f4006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.129966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f2e44-afb3-41af-811a-1dc60e1f4006 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.141413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1104/2190] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:21:44.145629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.156897 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f6693-03c2-4a28-b8f4-d54b3e1d8f1f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.161601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.162534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.162798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.163135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] PATH_INFO: `/v3/projects/e733ba7649434a9f887bfd1f0d3777e5/users/b921ca05cc6544d5a69055a30b7bd101/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.181115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e733ba7649434a9f887bfd1f0d3777e5, user_id=b921ca05cc6544d5a69055a30b7bd101, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.183994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.199561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1087/2191] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:44 2022] PUT /identity/v3/projects/e733ba7649434a9f887bfd1f0d3777e5/users/b921ca05cc6544d5a69055a30b7bd101/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:44.209734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.210020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.210463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.240981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] MFA Rules not processed for user `b921ca05cc6544d5a69055a30b7bd101`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:44.242369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:44.320182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1105/2192] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:44.324771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.393401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ef483-c414-4673-9f20-a303ca80a298 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.399175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.402598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.402598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.402598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.402598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.403251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.436391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1088/2193] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:44.437568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.448379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dbb84-ceb7-449d-b8a9-fc52e97d2abe None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.455932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.457917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:44.505048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.505716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.505990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.506258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.507030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.508944 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.516883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5e505-7282-47db-9716-edc4b3315b68 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.520788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.521505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.521828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.522075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.523933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:44.532612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1106/2194] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:21:44.533580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.534115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.535040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.542840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1089/2195] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:21:44.544052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a864c-1a53-4d15-a092-4f04bb351b42 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.548915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.549568 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.549848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.550123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.550843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.552928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.563431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1107/2196] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:44.567384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.580068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac06fb3-5ca9-4c49-bf1c-f87133cd1fb7 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.584932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e940d-28fd-4afc-a486-483f714bd941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.585610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e940d-28fd-4afc-a486-483f714bd941 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.585893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e940d-28fd-4afc-a486-483f714bd941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.586171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e940d-28fd-4afc-a486-483f714bd941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.586922 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e940d-28fd-4afc-a486-483f714bd941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.588555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e940d-28fd-4afc-a486-483f714bd941 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.602153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1090/2197] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:44.603360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.613370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9337f-7b74-47b5-a06a-722b0e5c6f21 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.618057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.618985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.619264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.619533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] PATH_INFO: `/v3/projects/9c368710948f4c07a66399f446c29386/users/c2bbe8bf7bd54c8da874a030f441dce2/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.634682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c368710948f4c07a66399f446c29386, user_id=c2bbe8bf7bd54c8da874a030f441dce2, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.637448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.653308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1108/2198] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:44 2022] PUT /identity/v3/projects/9c368710948f4c07a66399f446c29386/users/c2bbe8bf7bd54c8da874a030f441dce2/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:44.665187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.665456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.665911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.693520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] MFA Rules not processed for user `c2bbe8bf7bd54c8da874a030f441dce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:44.694753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:44.758304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1091/2199] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:44.762417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.825477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f74f7-75bc-454c-8760-fb57fce73dec admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.830393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.831114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.831378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.831652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.832358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.834343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.873833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.875366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:44.887915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1109/2200] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:44.893074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:44.966039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717050d-0b89-4472-960a-d9e0d930a21b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.972202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:44.972899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:44.973168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:44.973347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79078f-9888-4b31-aab8-ec9e78290a90 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:44.973469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:44.974160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:44.976078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:44.998903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1110/2201] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:21:44 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:45.002915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:45.013180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c1bf1-7c7f-4ff5-8bca-f42b65973644 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:45.018296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.018952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.019238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.019525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.020267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:45.021852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:45.036491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1111/2202] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:45.037349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:45.042716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b99e7835d04098ad38e4eee401ea91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.043714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.044151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.044596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.046929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:45.047057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f402-bfa4-4cfd-bda2-86db0c477a07 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:45.051734 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.052999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.053281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.053659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] PATH_INFO: `/v3/projects/4c53b820f6354e4d9e10cd8f0d710dd4/users/f7f05afd56c74a5d8f6ab35dc5b713df/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.060169 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:45.061852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:45.074669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1092/2203] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:21:45.076123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c53b820f6354e4d9e10cd8f0d710dd4, user_id=f7f05afd56c74a5d8f6ab35dc5b713df, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:45.078762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:45.093347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1112/2204] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:45 2022] PUT /identity/v3/projects/4c53b820f6354e4d9e10cd8f0d710dd4/users/f7f05afd56c74a5d8f6ab35dc5b713df/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:45.097164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:45.108355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95e85-be3a-491a-b59e-dcfd42d95410 service placement] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:45.167246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82615e77-0ba6-4722-937b-9fd04f9aac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.168220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615e77-0ba6-4722-937b-9fd04f9aac99 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.168474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615e77-0ba6-4722-937b-9fd04f9aac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.168746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82615e77-0ba6-4722-937b-9fd04f9aac99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.169526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82615e77-0ba6-4722-937b-9fd04f9aac99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:45.171256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82615e77-0ba6-4722-937b-9fd04f9aac99 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:45.182202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1093/2205] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:45.186626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:45.197801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e733c8d-1cb8-4c47-9e41-b01e9280d665 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:45.206039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.207148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.207533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.207901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] PATH_INFO: `/v3/projects/4c53b820f6354e4d9e10cd8f0d710dd4/users/f7f05afd56c74a5d8f6ab35dc5b713df/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.210399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c53b820f6354e4d9e10cd8f0d710dd4, user_id=f7f05afd56c74a5d8f6ab35dc5b713df, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:45.214240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:45.224617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1113/2206] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:45 2022] PUT /identity/v3/projects/4c53b820f6354e4d9e10cd8f0d710dd4/users/f7f05afd56c74a5d8f6ab35dc5b713df/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:45.235990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.236407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.236811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.270562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] MFA Rules not processed for user `f7f05afd56c74a5d8f6ab35dc5b713df`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:45.271916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:45.362145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1094/2207] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:45.376096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:45.378181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:45.443514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b81a0-60fd-4f8c-9891-ddce43b6fa6c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:45.447180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.447828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.448101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.448368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:45.457299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:45.458736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:45.467894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1114/2208] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:45.977002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:45.987246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0a08-4775-4fd3-9c72-71eba72f9124 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:45.991490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:45.992642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:45.993001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:45.993339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:46.052325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:46.053766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:46.063359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1095/2209] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:48.647623 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:48.649903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:48.751787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c64e-b47f-408e-a79c-2e987d32b602 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:48.759447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:48.760273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:48.760656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:48.760933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:48.763819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:48.784685 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:48.786324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:48.797687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1115/2210] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:50.225894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:50.235067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11e9c-cbc9-4fcc-a472-13b8aab7289b service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:50.238608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:50.239273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:50.239546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:50.239989 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:50.324136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:50.325582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:50.334951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1096/2211] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:50.575129 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:50.576779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:50.598726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32380ffd-74fd-4f8c-b4be-3534e311de6e service nova] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:50.614986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:50.615703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:50.617503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:50.617783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:50.624607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:50.652513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:50.656113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2399d5-a362-4eab-aafe-3cd74ce055be service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:50.682169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1116/2212] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:52.813320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:52.883132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b63f7-6767-40df-829c-5036973aa155 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:52.888095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:52.889124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:52.889405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:52.889672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] PATH_INFO: `/v3/users/b921ca05cc6544d5a69055a30b7bd101` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:52.891204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b921ca05cc6544d5a69055a30b7bd101)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:52.893128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:52.953908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b921ca05cc6544d5a69055a30b7bd101'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:52.963835 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b921ca05cc6544d5a69055a30b7bd101'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:52.971608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b921ca05cc6544d5a69055a30b7bd101'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:52.972341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b921ca05cc6544d5a69055a30b7bd101'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:52.986040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b921ca05cc6544d5a69055a30b7bd101'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:52.992966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1097/2213] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:21:52 2022] DELETE /identity/v3/users/b921ca05cc6544d5a69055a30b7bd101 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:52.997534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:52.998131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:52.998131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:53.019627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:53.020847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:53.102769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1117/2214] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:53.140278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:53.141934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:53.215655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba842b-515e-42f4-97ad-10a8831f7681 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:53.220904 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:53.221828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:53.222260 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:53.222681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:53.234237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:53.235725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:53.246215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1098/2215] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:53.771201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:53.772619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:53.787284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4340d2-11bd-41ec-bd98-a1074ffcd81b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:53.794464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:53.796458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:53.797038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:53.797652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] PATH_INFO: `/v3/projects/e733ba7649434a9f887bfd1f0d3777e5` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:53.799479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e733ba7649434a9f887bfd1f0d3777e5)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:53.804014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:53.871763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e733ba7649434a9f887bfd1f0d3777e5', 'request_id': 'req-7e8b048b-b568-4d17-9009-e77e7a8602cd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:53.881829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e733ba7649434a9f887bfd1f0d3777e5', 'request_id': 'req-7e8b048b-b568-4d17-9009-e77e7a8602cd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:53.889833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e733ba7649434a9f887bfd1f0d3777e5', 'request_id': 'req-7e8b048b-b568-4d17-9009-e77e7a8602cd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:53.902175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] The token cache is being invalidate because project e733ba7649434a9f887bfd1f0d3777e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:21:53.902335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:53.903056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:53.906932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1118/2216] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:21:53 2022] DELETE /identity/v3/projects/e733ba7649434a9f887bfd1f0d3777e5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:53.909223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:53.920271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ecda8-3618-4608-8223-4e70e10d7e5f service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:53.981932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:53.982973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:53.983264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:53.983534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] PATH_INFO: `/v3/users/c2bbe8bf7bd54c8da874a030f441dce2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:53.984871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2bbe8bf7bd54c8da874a030f441dce2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:53.986840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:54.042588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2bbe8bf7bd54c8da874a030f441dce2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.049560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2bbe8bf7bd54c8da874a030f441dce2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.057425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2bbe8bf7bd54c8da874a030f441dce2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.058158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2bbe8bf7bd54c8da874a030f441dce2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.071876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2bbe8bf7bd54c8da874a030f441dce2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.077921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1099/2217] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:21:53 2022] DELETE /identity/v3/users/c2bbe8bf7bd54c8da874a030f441dce2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:54.527984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:54.529485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:54.542849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b048b-b568-4d17-9009-e77e7a8602cd admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:54.621026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:54.622171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:54.622449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:54.623476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] PATH_INFO: `/v3/projects/9c368710948f4c07a66399f446c29386` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:54.624709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c368710948f4c07a66399f446c29386)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:54.627639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:54.677655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c368710948f4c07a66399f446c29386', 'request_id': 'req-f26c5892-4be6-41df-a3d4-5fee6572734c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.688688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c368710948f4c07a66399f446c29386', 'request_id': 'req-f26c5892-4be6-41df-a3d4-5fee6572734c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.698529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c368710948f4c07a66399f446c29386', 'request_id': 'req-f26c5892-4be6-41df-a3d4-5fee6572734c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.714771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] The token cache is being invalidate because project 9c368710948f4c07a66399f446c29386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:21:54.715162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.715960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.718285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1119/2218] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:21:54 2022] DELETE /identity/v3/projects/9c368710948f4c07a66399f446c29386 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:54.722807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:54.725955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:54.752123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d10372-1a69-4557-b9ce-d121783ea8c8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:54.815502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:54.816591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:54.817010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:54.817474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] PATH_INFO: `/v3/users/f7f05afd56c74a5d8f6ab35dc5b713df` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:54.818832 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f05afd56c74a5d8f6ab35dc5b713df)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:54.820792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:54.874662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f05afd56c74a5d8f6ab35dc5b713df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.884105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f05afd56c74a5d8f6ab35dc5b713df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.891233 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f05afd56c74a5d8f6ab35dc5b713df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.891914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f05afd56c74a5d8f6ab35dc5b713df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.904640 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f05afd56c74a5d8f6ab35dc5b713df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:54.910908 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1100/2219] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:21:54 2022] DELETE /identity/v3/users/f7f05afd56c74a5d8f6ab35dc5b713df => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:55.203646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.205348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.218345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.220348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.316711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5892-4be6-41df-a3d4-5fee6572734c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.332185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70426091-e287-4e06-b9f3-9044a1837241 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.337060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.338042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.338457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.338775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] PATH_INFO: `/v3/projects/4c53b820f6354e4d9e10cd8f0d710dd4` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.340068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c53b820f6354e4d9e10cd8f0d710dd4)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.341891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.389584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c53b820f6354e4d9e10cd8f0d710dd4', 'request_id': 'req-556e7136-46a2-42ce-9f03-34d473a32685'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:55.391252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.391908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.392180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.392448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.394193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.396484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c53b820f6354e4d9e10cd8f0d710dd4', 'request_id': 'req-556e7136-46a2-42ce-9f03-34d473a32685'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:55.404822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c53b820f6354e4d9e10cd8f0d710dd4', 'request_id': 'req-556e7136-46a2-42ce-9f03-34d473a32685'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:55.406564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.408322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa78e7e-57b6-4627-ae87-1d050d7c9f1f service nova] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.416147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] The token cache is being invalidate because project 4c53b820f6354e4d9e10cd8f0d710dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:21:55.416469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:55.417135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-556e7136-46a2-42ce-9f03-34d473a32685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:21:55.418718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1120/2220] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:55.419066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1101/2221] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:21:55 2022] DELETE /identity/v3/projects/4c53b820f6354e4d9e10cd8f0d710dd4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:55.424263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffec9-7962-4c60-bb38-a4dde5858248 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.424615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffec9-7962-4c60-bb38-a4dde5858248 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.424856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.425150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffec9-7962-4c60-bb38-a4dde5858248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.425268 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.425375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.443198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-021ffec9-7962-4c60-bb38-a4dde5858248 None None] MFA Rules not processed for user `090f701bb7e54a72ab9a5c84fba01fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:55.443526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:55.444473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-021ffec9-7962-4c60-bb38-a4dde5858248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.444659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.499498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1121/2222] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:55.502325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1102/2223] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:21:55.510254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.510540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.510816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.529029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:55.530371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.538617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1122/2224] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:55.543055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.558014 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaf71f-94b2-4b10-830f-73ae3801a0d9 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.564142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.564809 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.565086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.565485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.566486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:21:55.566791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.568487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.580542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1103/2225] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:21:55.584875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.594754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3510a-de28-4928-99b9-d0c1a9fbb5d8 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.599666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.600312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.600582 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.600847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.601540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.603462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.629282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1123/2226] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:55.633245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.642777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569bbd1-9f18-4eba-859f-6845497ac339 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.698234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.698828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.699155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.699459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.700165 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.702124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.722921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1104/2227] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:21:55.726550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.737260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc391d-547a-45f3-8c63-20ca069a3f40 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.742423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.743117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.743415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.743668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.744385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.746021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.757376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1124/2228] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:55.761754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.771930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bf81b-d1a2-47ea-b284-f68ec4d12412 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.776661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce3dc0-27d2-4584-b5f0-19e426728e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.777320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3dc0-27d2-4584-b5f0-19e426728e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.777600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3dc0-27d2-4584-b5f0-19e426728e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.777864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3dc0-27d2-4584-b5f0-19e426728e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.778584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3dc0-27d2-4584-b5f0-19e426728e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.780305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3dc0-27d2-4584-b5f0-19e426728e88 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.790360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1105/2229] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:55.794581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:55.804793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2783af-d78b-4497-83c2-e7febe6711e6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:55.810097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:55.811128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.811454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.811786 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] PATH_INFO: `/v3/projects/d1447bec03c24d42bea9e303453ad734/users/b4748913d7e34572a537b8ce40ddbb7f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.826432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1447bec03c24d42bea9e303453ad734, user_id=b4748913d7e34572a537b8ce40ddbb7f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:55.829448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:55.848035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1125/2230] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:55 2022] PUT /identity/v3/projects/d1447bec03c24d42bea9e303453ad734/users/b4748913d7e34572a537b8ce40ddbb7f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:55.865875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:55.866135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:55.866498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:55.893625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] MFA Rules not processed for user `b4748913d7e34572a537b8ce40ddbb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:55.895009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:55.964285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1106/2231] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:21:55.968803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.028715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d4395-02df-45a4-97a6-79502aecb286 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.033299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.033952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.034224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.034488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.035237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.037090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.068061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1126/2232] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:21:55 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:56.072379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.083752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7aca6-116b-42af-af57-085e16bae41c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.150061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.151052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.151474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.151911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.153009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.156348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.189788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1107/2233] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:21:56 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:21:56.191263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.202910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36cc4-c424-4867-98ae-f1cbeed91f0d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.208437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.209308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.209590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.209854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.210583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.212379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.230923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1127/2234] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:56.233364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.261648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f74bcc-15f2-4e1a-9e42-9ec31eeec628 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.267243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.268151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.268432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.268701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] PATH_INFO: `/v3/projects/8ea2827316b448da9c0e0102cbcfe6eb/users/75d88c8bd5f84bdbb7838efd6ff82716/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.284618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea2827316b448da9c0e0102cbcfe6eb, user_id=75d88c8bd5f84bdbb7838efd6ff82716, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.287581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.309940 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1108/2235] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:56 2022] PUT /identity/v3/projects/8ea2827316b448da9c0e0102cbcfe6eb/users/75d88c8bd5f84bdbb7838efd6ff82716/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:56.311347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.325149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe42ed-3f29-499c-aa86-6452557ef7f6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.394170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6214d-a426-4b3e-ae64-9848a340828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.395082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6214d-a426-4b3e-ae64-9848a340828c admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.395301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6214d-a426-4b3e-ae64-9848a340828c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.395528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6214d-a426-4b3e-ae64-9848a340828c admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.396202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6214d-a426-4b3e-ae64-9848a340828c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.397874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6214d-a426-4b3e-ae64-9848a340828c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.413208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1128/2236] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:21:56.417714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.428731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2960b-b9bf-4bb3-87e1-ac6c88e15464 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.434003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.434924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.435205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.435469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] PATH_INFO: `/v3/projects/8ea2827316b448da9c0e0102cbcfe6eb/users/75d88c8bd5f84bdbb7838efd6ff82716/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.437618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea2827316b448da9c0e0102cbcfe6eb, user_id=75d88c8bd5f84bdbb7838efd6ff82716, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.440573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.452767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1109/2237] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:21:56 2022] PUT /identity/v3/projects/8ea2827316b448da9c0e0102cbcfe6eb/users/75d88c8bd5f84bdbb7838efd6ff82716/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:21:56.463393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.463698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.463967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.492483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] MFA Rules not processed for user `75d88c8bd5f84bdbb7838efd6ff82716`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:56.493766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:56.564193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1129/2238] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:21:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:56.576171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.577998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:56.649344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92a169-2a1b-43ec-a458-b8b117560377 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.653660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81bed6-b99f-421f-8a53-f9473ebbc3e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.654328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81bed6-b99f-421f-8a53-f9473ebbc3e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.654634 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81bed6-b99f-421f-8a53-f9473ebbc3e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.654930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81bed6-b99f-421f-8a53-f9473ebbc3e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.664660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81bed6-b99f-421f-8a53-f9473ebbc3e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.666085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81bed6-b99f-421f-8a53-f9473ebbc3e4 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.676133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1110/2239] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:56.723611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:56.725070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:56.739409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec3dfe-1ede-448a-b408-70eaa3d1c1bf None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:21:56.743695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:21:56.744340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:56.744632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:56.745002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:56.803022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:21:56.804463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:21:56.813489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1130/2240] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:21:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:21:59.863767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:21:59.864256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:21:59.864353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:21:59.882393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:21:59.883637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:21:59.940742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1111/2241] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 4 08:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:21:59.991903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:21:59.993458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:00.069898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17ffe0-b7fe-4f25-801d-3a2c0b4dad42 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:00.077459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0a18b-a693-4b0c-824a-3d1e7e503b25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:00.078237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0a18b-a693-4b0c-824a-3d1e7e503b25 service swift] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:00.078580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0a18b-a693-4b0c-824a-3d1e7e503b25 service swift] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:00.078968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0a18b-a693-4b0c-824a-3d1e7e503b25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:00.088990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0a18b-a693-4b0c-824a-3d1e7e503b25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:00.090889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0a18b-a693-4b0c-824a-3d1e7e503b25 service swift] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:00.099593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1131/2242] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:22:00.182780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:00.272123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87623cd0-2b39-40e8-81b7-f43e50b82775 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:00.286059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:00.288054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:00.288332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:00.288602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] PATH_INFO: `/v3/users/b4748913d7e34572a537b8ce40ddbb7f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:00.290569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4748913d7e34572a537b8ce40ddbb7f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:00.293353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:00.366980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4748913d7e34572a537b8ce40ddbb7f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:00.377446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4748913d7e34572a537b8ce40ddbb7f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:00.388604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4748913d7e34572a537b8ce40ddbb7f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:00.389680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4748913d7e34572a537b8ce40ddbb7f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:00.406090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4748913d7e34572a537b8ce40ddbb7f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:00.413890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1112/2243] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:00 2022] DELETE /identity/v3/users/b4748913d7e34572a537b8ce40ddbb7f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:00.418310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:00.418597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:00.418870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:00.438251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:00.439508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:00.522676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1132/2244] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:00.543264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:00.545025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:00.625959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b0514-c1aa-4808-91e1-49cccef9253d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:00.639408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:00.640296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:00.640730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:00.641154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:00.651633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:00.653311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:00.667200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1113/2245] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:01.340923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:01.343425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:01.363841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf804a8-f3c7-4158-9524-7070bd413785 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:01.373921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:01.376156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:01.376848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:01.377307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] PATH_INFO: `/v3/projects/d1447bec03c24d42bea9e303453ad734` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:01.378933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1447bec03c24d42bea9e303453ad734)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:01.381076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:01.476843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1447bec03c24d42bea9e303453ad734', 'request_id': 'req-41d6c8d0-415e-4152-8762-a69a056e8d71'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.488006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1447bec03c24d42bea9e303453ad734', 'request_id': 'req-41d6c8d0-415e-4152-8762-a69a056e8d71'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.498591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1447bec03c24d42bea9e303453ad734', 'request_id': 'req-41d6c8d0-415e-4152-8762-a69a056e8d71'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.511521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] The token cache is being invalidate because project d1447bec03c24d42bea9e303453ad734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:01.512247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.513775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.516188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1133/2246] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:01 2022] DELETE /identity/v3/projects/d1447bec03c24d42bea9e303453ad734 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:01.520508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:01.533190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6ff9-3ce5-4ff1-95be-7cb48690f455 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:01.648817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:01.649999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:01.650464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:01.650946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] PATH_INFO: `/v3/users/75d88c8bd5f84bdbb7838efd6ff82716` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:01.652519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d88c8bd5f84bdbb7838efd6ff82716)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:01.654756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:01.721934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d88c8bd5f84bdbb7838efd6ff82716'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.734236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d88c8bd5f84bdbb7838efd6ff82716'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.744723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d88c8bd5f84bdbb7838efd6ff82716'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.748622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d88c8bd5f84bdbb7838efd6ff82716'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.769970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c21d2a37-c594-4780-85e2-6ff036123e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d88c8bd5f84bdbb7838efd6ff82716'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:01.783885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1114/2247] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:01 2022] DELETE /identity/v3/users/75d88c8bd5f84bdbb7838efd6ff82716 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:02.334943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.336324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:02.348981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c8d0-415e-4152-8762-a69a056e8d71 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.420265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.421259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.422017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.422017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] PATH_INFO: `/v3/projects/8ea2827316b448da9c0e0102cbcfe6eb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.423410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea2827316b448da9c0e0102cbcfe6eb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.425396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.471816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea2827316b448da9c0e0102cbcfe6eb', 'request_id': 'req-49a173bd-a86b-4802-a2b8-b8a758da4ab7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:02.480291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea2827316b448da9c0e0102cbcfe6eb', 'request_id': 'req-49a173bd-a86b-4802-a2b8-b8a758da4ab7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:02.487373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea2827316b448da9c0e0102cbcfe6eb', 'request_id': 'req-49a173bd-a86b-4802-a2b8-b8a758da4ab7'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:02.499541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] The token cache is being invalidate because project 8ea2827316b448da9c0e0102cbcfe6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:02.499798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:02.500607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49a173bd-a86b-4802-a2b8-b8a758da4ab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:02.502350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1134/2248] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:02 2022] DELETE /identity/v3/projects/8ea2827316b448da9c0e0102cbcfe6eb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:02.507520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.507896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.508228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.527627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:02.528986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:02.592688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1115/2249] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:02.602007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.602260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.602567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.622250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:02.623793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:02.632567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1135/2250] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:02.637301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.647560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc9f22-774d-4333-aff8-7dab2db9c3cd None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.652556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.653228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.653715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.653991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.654787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:22:02.655223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.656879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.671046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1116/2251] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:22:02.676151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.687320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f896-cd68-4e5f-a8af-45f8125cb7ec None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.691923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.692584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.692862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.693187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.693875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.695879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.725948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1136/2252] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:02 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:02.727553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.738061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cfa84-ad6a-4c8b-b7d8-0449993900b7 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.798592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.799297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.799575 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.799844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.800544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.802785 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.831571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1117/2253] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:02 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:22:02.832856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.843167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d36c8-9ba8-49e4-baa1-dd3ebf0d4075 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.848261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.848920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.849195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.849489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.850215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.851886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.863932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1137/2254] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:02.867725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.880202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428202b-709d-408c-bc80-8ee6d0e514e3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.885113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f137f9f-2f86-43c6-a114-ed744da35814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.885819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f137f9f-2f86-43c6-a114-ed744da35814 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.886096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f137f9f-2f86-43c6-a114-ed744da35814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.886366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f137f9f-2f86-43c6-a114-ed744da35814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.887244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f137f9f-2f86-43c6-a114-ed744da35814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.889055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f137f9f-2f86-43c6-a114-ed744da35814 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.899869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1118/2255] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:02.904892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:02.917333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecc581-1999-45d6-99d8-c401eff3784b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:02.922606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:02.923514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.923789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.924717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] PATH_INFO: `/v3/projects/0daf89a55cd5470b983b17e5b64dc085/users/ce0af9aa83014a8aa70459faabb15ad6/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.939687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daf89a55cd5470b983b17e5b64dc085, user_id=ce0af9aa83014a8aa70459faabb15ad6, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:02.943028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:02.956441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1138/2256] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:02 2022] PUT /identity/v3/projects/0daf89a55cd5470b983b17e5b64dc085/users/ce0af9aa83014a8aa70459faabb15ad6/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:02.966646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:02.967003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:02.967282 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:02.993859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] MFA Rules not processed for user `ce0af9aa83014a8aa70459faabb15ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:02.995028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:03.079767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1119/2257] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:03.084140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.148457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7776a6c-8fbd-4bab-8a6b-64b28e2be203 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.153375 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.154272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.154648 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.155010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.155821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.158429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.186641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1139/2258] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:03 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:03.190366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.202061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e743a-4db2-44c6-a9f8-1e89e5fe62cd None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.270935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.272207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.272740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.273149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.273838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.276769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.305002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1120/2259] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:03 2022] POST /identity/v3/users => generated 306 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:03.306577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.320181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e899086-b866-48b0-b440-31085f4f45ca admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.326746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.326746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.327023 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.327220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.327910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.329520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.344039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1140/2260] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:03.345187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.356874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc653cf-f502-410d-bf17-31289ff52c53 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.363289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.364191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.364471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.364741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] PATH_INFO: `/v3/projects/dd71f39c20a44643846c96d62500ed79/users/46eab5d4e5874756962581e6030723d5/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.381043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd71f39c20a44643846c96d62500ed79, user_id=46eab5d4e5874756962581e6030723d5, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.386909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.412676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1121/2261] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:03 2022] PUT /identity/v3/projects/dd71f39c20a44643846c96d62500ed79/users/46eab5d4e5874756962581e6030723d5/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:03.416501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.441082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68f67d-7080-4a9f-b869-0370506a8dc1 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.535317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.538449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:03.561302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.564720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.565241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.565838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.567100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.569180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.587459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1141/2262] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:03.589089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.602978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ef98b-3224-406b-bfee-bd6c35c566a5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.609559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeb5b6-7ed9-4eea-8f52-68392e7b2365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.612000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb5b6-7ed9-4eea-8f52-68392e7b2365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.612513 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb5b6-7ed9-4eea-8f52-68392e7b2365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.612995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb5b6-7ed9-4eea-8f52-68392e7b2365 admin admin] PATH_INFO: `/v3/projects/dd71f39c20a44643846c96d62500ed79/users/46eab5d4e5874756962581e6030723d5/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.616317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb5b6-7ed9-4eea-8f52-68392e7b2365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd71f39c20a44643846c96d62500ed79, user_id=46eab5d4e5874756962581e6030723d5, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.620844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb5b6-7ed9-4eea-8f52-68392e7b2365 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.647141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1142/2263] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:03 2022] PUT /identity/v3/projects/dd71f39c20a44643846c96d62500ed79/users/46eab5d4e5874756962581e6030723d5/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:03.658281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.658644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.659311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.674210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692b38a-97da-422c-838f-9afbded82d17 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.688137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] MFA Rules not processed for user `46eab5d4e5874756962581e6030723d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:03.689351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:03.760713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1143/2264] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:03.773725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.775230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:03.786145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268f6afa0af84c6b9a6807975bb8db87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.787338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.787900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.788181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.790266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:03.835922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc444a4-791c-4661-95a6-81f088285e50 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.839640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.840334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.840618 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.840880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:03.850960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.852462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.853711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:03.855502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:03.863305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1144/2265] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:03.865867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1122/2266] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:03.956328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:03.957889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:03.970195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4836-ebda-40b3-885c-4ce4d2fc3131 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:03.974183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676da04f-82bc-46e2-829e-bd02c874e4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:03.974848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da04f-82bc-46e2-829e-bd02c874e4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:03.975173 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da04f-82bc-46e2-829e-bd02c874e4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:03.975445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da04f-82bc-46e2-829e-bd02c874e4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:04.037603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da04f-82bc-46e2-829e-bd02c874e4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:04.039048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676da04f-82bc-46e2-829e-bd02c874e4d3 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:04.048271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1145/2267] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:08.286727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:08.350895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bc1cf-72e1-4a70-9977-1452bbb26013 service nova] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:08.355404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:08.356400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:08.356679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:08.356949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] PATH_INFO: `/v3/users/ce0af9aa83014a8aa70459faabb15ad6` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:08.358235 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0af9aa83014a8aa70459faabb15ad6)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:08.360210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:08.415248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0af9aa83014a8aa70459faabb15ad6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:08.424181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0af9aa83014a8aa70459faabb15ad6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:08.431902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0af9aa83014a8aa70459faabb15ad6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:08.432764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0af9aa83014a8aa70459faabb15ad6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:08.448072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0af9aa83014a8aa70459faabb15ad6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:08.458703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1123/2268] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:08 2022] DELETE /identity/v3/users/ce0af9aa83014a8aa70459faabb15ad6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:08.463892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:08.464688 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:08.465084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:08.483068 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:08.484378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:08.574579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1146/2269] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:08.585098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:08.586894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:08.667567 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56186430-2fde-4c9e-9667-07c628fb288a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:08.671745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:08.672395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:08.672674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:08.672943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:08.684680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:08.686143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:08.696875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1124/2270] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:09.054210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:09.056697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:09.070221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e5ce0-4040-4542-b9fb-f1d9c24c16c5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:09.075584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:09.076689 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:09.076950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:09.077389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] PATH_INFO: `/v3/projects/0daf89a55cd5470b983b17e5b64dc085` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:09.078995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0daf89a55cd5470b983b17e5b64dc085)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:09.081938 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:09.132932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0daf89a55cd5470b983b17e5b64dc085', 'request_id': 'req-8a643d1c-3e31-4e31-955f-2f9036d7558d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.142390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0daf89a55cd5470b983b17e5b64dc085', 'request_id': 'req-8a643d1c-3e31-4e31-955f-2f9036d7558d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.152883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0daf89a55cd5470b983b17e5b64dc085', 'request_id': 'req-8a643d1c-3e31-4e31-955f-2f9036d7558d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.171235 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] The token cache is being invalidate because project 0daf89a55cd5470b983b17e5b64dc085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:09.172009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.172741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.174815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1147/2271] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:09 2022] DELETE /identity/v3/projects/0daf89a55cd5470b983b17e5b64dc085 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:09.179019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:09.191591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c920-7662-4503-a10b-d44bb5aa03b6 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:09.252457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:09.253648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:09.253923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:09.254191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] PATH_INFO: `/v3/users/46eab5d4e5874756962581e6030723d5` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:09.255444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46eab5d4e5874756962581e6030723d5)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:09.257359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:09.297407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:09.299104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:09.312449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46eab5d4e5874756962581e6030723d5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.319995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46eab5d4e5874756962581e6030723d5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.320268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a643d1c-3e31-4e31-955f-2f9036d7558d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:09.325381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:09.326319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:09.326656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:09.327037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] PATH_INFO: `/v3/users/e74effe5c01e4e0e87650d0dc97b8e0b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:09.327219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46eab5d4e5874756962581e6030723d5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.327917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46eab5d4e5874756962581e6030723d5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.328249 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74effe5c01e4e0e87650d0dc97b8e0b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:09.330188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:09.339569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46eab5d4e5874756962581e6030723d5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.345834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1125/2272] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:09 2022] DELETE /identity/v3/users/46eab5d4e5874756962581e6030723d5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:09.379762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74effe5c01e4e0e87650d0dc97b8e0b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.388958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74effe5c01e4e0e87650d0dc97b8e0b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.396148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74effe5c01e4e0e87650d0dc97b8e0b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.396799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74effe5c01e4e0e87650d0dc97b8e0b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.397404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74effe5c01e4e0e87650d0dc97b8e0b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.418970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1148/2273] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:09 2022] DELETE /identity/v3/users/e74effe5c01e4e0e87650d0dc97b8e0b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:09.707996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:09.710322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:09.720790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:09.723440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:09.816947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43accfa1-3317-4780-9b7b-21ada6db8065 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:09.821069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7f02-55e5-4180-8054-918318533221 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:09.822056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:09.823065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:09.823423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:09.823879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] PATH_INFO: `/v3/projects/dd71f39c20a44643846c96d62500ed79` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:09.825067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd71f39c20a44643846c96d62500ed79)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:09.827199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:09.827524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:09.828451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:09.828791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:09.829122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] PATH_INFO: `/v3/projects/f62edba9a4f9457c82909ceed58104c3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:09.830422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62edba9a4f9457c82909ceed58104c3)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:09.832406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:09.880360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd71f39c20a44643846c96d62500ed79', 'request_id': 'req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.891697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd71f39c20a44643846c96d62500ed79', 'request_id': 'req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.899398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62edba9a4f9457c82909ceed58104c3', 'request_id': 'req-f2928586-84f6-4cb7-9b68-4a77554f8414'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.900841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd71f39c20a44643846c96d62500ed79', 'request_id': 'req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.907921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62edba9a4f9457c82909ceed58104c3', 'request_id': 'req-f2928586-84f6-4cb7-9b68-4a77554f8414'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.915739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] The token cache is being invalidate because project dd71f39c20a44643846c96d62500ed79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:09.916288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.916754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62edba9a4f9457c82909ceed58104c3', 'request_id': 'req-f2928586-84f6-4cb7-9b68-4a77554f8414'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.917376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-29a4d3d3-71ae-47a6-8726-e5cf4b79e325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.919295 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1149/2274] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:09 2022] DELETE /identity/v3/projects/dd71f39c20a44643846c96d62500ed79 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:09.924392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd8c83-54b8-4478-9fd8-84c6fd33054f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:09.924682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd8c83-54b8-4478-9fd8-84c6fd33054f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:09.924959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd8c83-54b8-4478-9fd8-84c6fd33054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:09.935772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] The token cache is being invalidate because project f62edba9a4f9457c82909ceed58104c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:09.936065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.936899 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:09.944338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1126/2275] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:09 2022] DELETE /identity/v3/projects/f62edba9a4f9457c82909ceed58104c3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:09.944548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d1fd8c83-54b8-4478-9fd8-84c6fd33054f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:09.946130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d1fd8c83-54b8-4478-9fd8-84c6fd33054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:09.947374 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:09.948827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:10.024371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1150/2276] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:22:10.031008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2928586-84f6-4cb7-9b68-4a77554f8414 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.032952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.033340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.033705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.054933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.056477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.057100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.057516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] PATH_INFO: `/v3/users/a413a11fb0a74a03970fb2ad22390d15` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.058563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:10.059245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a413a11fb0a74a03970fb2ad22390d15)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.059960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:10.060952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.071299 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1151/2277] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:22:10.075260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.086348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d27d8-ba3c-4e81-a8eb-be37c83a24bc None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.093395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.094182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.094453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.094723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.095479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:22:10.096269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.097739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.111049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1152/2278] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:22:10.115410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.123627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a413a11fb0a74a03970fb2ad22390d15'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.126392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47df45d-5869-42c9-a5d3-2d24b8aa832d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.132052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.132760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.132934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a413a11fb0a74a03970fb2ad22390d15'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.133061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.133300 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.134162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.136650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.142163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a413a11fb0a74a03970fb2ad22390d15'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.143341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a413a11fb0a74a03970fb2ad22390d15'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.163531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a413a11fb0a74a03970fb2ad22390d15'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.180927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1127/2279] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:09 2022] DELETE /identity/v3/users/a413a11fb0a74a03970fb2ad22390d15 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:10.181160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1153/2280] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:10 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:22:10.185893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.187622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:10.266519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5174ca-a77c-44c5-a42a-de134dc24d57 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.327845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.328533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.328894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.329232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.330035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.332069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.355910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1128/2281] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:10 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:10.360562 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.372197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a007-5a39-45a0-80ef-9239baffb92f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.377790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.378632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.379009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.379599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.380766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.382754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.402722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1154/2282] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:10.404256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.415230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc01954-4e9e-4382-861d-d74cfe7596f4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.420301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde351cf-f1e2-4a08-89ef-6a97c250d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.421393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde351cf-f1e2-4a08-89ef-6a97c250d5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.421393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde351cf-f1e2-4a08-89ef-6a97c250d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.421780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde351cf-f1e2-4a08-89ef-6a97c250d5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.422866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde351cf-f1e2-4a08-89ef-6a97c250d5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.424559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde351cf-f1e2-4a08-89ef-6a97c250d5a4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.438476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1129/2283] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:22:10.439633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.449784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4528148-ffad-4f84-985a-77f9297baf0a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.454730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.455789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.456060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.456421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] PATH_INFO: `/v3/projects/153f00a006fa4ae1a894d06aebbf3b00/users/0599d35d46704137b86690affd289946/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.477768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153f00a006fa4ae1a894d06aebbf3b00, user_id=0599d35d46704137b86690affd289946, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.480657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.494339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1155/2284] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:10 2022] PUT /identity/v3/projects/153f00a006fa4ae1a894d06aebbf3b00/users/0599d35d46704137b86690affd289946/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:10.506153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.506440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.506707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.532560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.534553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:10.536448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] MFA Rules not processed for user `0599d35d46704137b86690affd289946`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:10.537983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:10.612643 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8f70d-5b95-4578-ada3-748f7491fd81 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.615477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1130/2285] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:22:10.617812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.618740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.619030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.620127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.620824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] PATH_INFO: `/v3/projects/b22a9c819c2f4500922f7a5c27ac60f4` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.622120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22a9c819c2f4500922f7a5c27ac60f4)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.624370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.632255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f96f-f363-4efa-bff6-f68a6f070c16 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.640212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556948-31de-47da-9681-7801364d9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.641002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556948-31de-47da-9681-7801364d9296 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.641347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556948-31de-47da-9681-7801364d9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.641738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556948-31de-47da-9681-7801364d9296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.642498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556948-31de-47da-9681-7801364d9296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.644517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556948-31de-47da-9681-7801364d9296 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.674096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22a9c819c2f4500922f7a5c27ac60f4', 'request_id': 'req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.675457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1131/2286] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:10 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:10.676331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556948-31de-47da-9681-7801364d9296 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.691272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22a9c819c2f4500922f7a5c27ac60f4', 'request_id': 'req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.699704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22a9c819c2f4500922f7a5c27ac60f4', 'request_id': 'req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.715362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] The token cache is being invalidate because project b22a9c819c2f4500922f7a5c27ac60f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:10.715883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.716819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:10.719717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1156/2287] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:10 2022] DELETE /identity/v3/projects/b22a9c819c2f4500922f7a5c27ac60f4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:10.752731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556948-31de-47da-9681-7801364d9296 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.757613 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.758473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.758795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.759173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.759936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.762422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.785194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1132/2288] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:10 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:10.789427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.791105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:10.874193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259603f-bb29-48d5-b3ed-b0cfc27d86b8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.880002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.881087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.881371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.881649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.882398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.884132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.895567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1157/2289] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:10.899953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.912521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219214-ff0e-4933-b211-b583da77c106 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:10.917539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:10.918626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:10.919050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:10.924156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] PATH_INFO: `/v3/projects/0561028808054431a1776a5d314367e9/users/dab1391eabc74b6f825ef908ead188c3/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:10.959193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0561028808054431a1776a5d314367e9, user_id=dab1391eabc74b6f825ef908ead188c3, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:10.962115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:10.983947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1133/2290] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:10 2022] PUT /identity/v3/projects/0561028808054431a1776a5d314367e9/users/dab1391eabc74b6f825ef908ead188c3/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:10.987966 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:10.997850 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a391a0-0f20-4055-aa98-ee01965dcccf admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:11.058002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075aca6-e313-4c2d-90b1-50d64dcbe742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:11.059065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075aca6-e313-4c2d-90b1-50d64dcbe742 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:11.059780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075aca6-e313-4c2d-90b1-50d64dcbe742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:11.059780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075aca6-e313-4c2d-90b1-50d64dcbe742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:11.060514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075aca6-e313-4c2d-90b1-50d64dcbe742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:11.062103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075aca6-e313-4c2d-90b1-50d64dcbe742 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:11.081276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1158/2291] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:11.085481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:11.099363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de14f-9c4e-4278-9b3c-735e04368d8c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:11.107306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:11.108432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:11.108777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:11.109107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] PATH_INFO: `/v3/projects/0561028808054431a1776a5d314367e9/users/dab1391eabc74b6f825ef908ead188c3/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:11.111211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0561028808054431a1776a5d314367e9, user_id=dab1391eabc74b6f825ef908ead188c3, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:11.114217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:11.130425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1134/2292] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:11 2022] PUT /identity/v3/projects/0561028808054431a1776a5d314367e9/users/dab1391eabc74b6f825ef908ead188c3/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:11.148188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:11.148597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:11.148880 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:11.182556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] MFA Rules not processed for user `dab1391eabc74b6f825ef908ead188c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:11.184313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:11.263415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1159/2293] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:11.274496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:11.277055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:11.343082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfb30e-65bd-4391-9286-320907e462b3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:11.347032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:11.347740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:11.348099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:11.348430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:11.350287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:11.427063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:11.428647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:11.442347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1135/2294] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:15.708467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:15.710175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:15.723597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6829-5051-448e-ac70-72f4238ff73a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:15.728232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560e400-97d2-4238-8490-5548dd9d5e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:15.728889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e400-97d2-4238-8490-5548dd9d5e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:15.729162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e400-97d2-4238-8490-5548dd9d5e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:15.729414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e400-97d2-4238-8490-5548dd9d5e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:15.739641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560e400-97d2-4238-8490-5548dd9d5e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:15.741103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560e400-97d2-4238-8490-5548dd9d5e0e service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:15.751817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1160/2295] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:20.615426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:20.690726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ed59d-e812-4d42-978c-75fa1d483e27 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:20.695980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:20.696890 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:20.697153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:20.697423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] PATH_INFO: `/v3/users/0599d35d46704137b86690affd289946` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:20.698725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0599d35d46704137b86690affd289946)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:20.700767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:20.750804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0599d35d46704137b86690affd289946'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:20.759211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0599d35d46704137b86690affd289946'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:20.766679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0599d35d46704137b86690affd289946'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:20.767499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0599d35d46704137b86690affd289946'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:20.779249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0599d35d46704137b86690affd289946'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:20.785503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1136/2296] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:20 2022] DELETE /identity/v3/users/0599d35d46704137b86690affd289946 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:20.790308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:20.790848 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:20.790988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:20.811512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:20.813647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:20.877268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1161/2297] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:20.886749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:20.888223 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:20.946915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec50b17-a971-49f2-91dc-cb0697569bd7 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:20.950580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:20.951253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:20.951531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:20.951803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:20.960921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:20.962353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:20.971903 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1137/2298] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:21.259723 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:21.261224 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:21.278340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f29bf4-8f0e-4914-9e05-f3aa07760944 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:21.285115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:21.286041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:21.286261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:21.286533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] PATH_INFO: `/v3/projects/153f00a006fa4ae1a894d06aebbf3b00` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:21.287914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=153f00a006fa4ae1a894d06aebbf3b00)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:21.290411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:21.339916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153f00a006fa4ae1a894d06aebbf3b00', 'request_id': 'req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.347350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153f00a006fa4ae1a894d06aebbf3b00', 'request_id': 'req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.353955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153f00a006fa4ae1a894d06aebbf3b00', 'request_id': 'req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.364209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] The token cache is being invalidate because project 153f00a006fa4ae1a894d06aebbf3b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:21.364483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.365144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.366728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1162/2299] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:21 2022] DELETE /identity/v3/projects/153f00a006fa4ae1a894d06aebbf3b00 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:21.371067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:21.380919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f4261-8fe7-40a5-8ab6-0ac1c98e0c32 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:21.438185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:21.439123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:21.439395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:21.439663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] PATH_INFO: `/v3/users/dab1391eabc74b6f825ef908ead188c3` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:21.441045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab1391eabc74b6f825ef908ead188c3)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:21.443069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:21.491251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab1391eabc74b6f825ef908ead188c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.499545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab1391eabc74b6f825ef908ead188c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.506322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab1391eabc74b6f825ef908ead188c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.506907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab1391eabc74b6f825ef908ead188c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.518334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ce17d0f7-63bd-4727-88a5-bde251c6b43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab1391eabc74b6f825ef908ead188c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.524360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1138/2300] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:21 2022] DELETE /identity/v3/users/dab1391eabc74b6f825ef908ead188c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:21.801237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:21.803256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:21.816505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b99d51-5e09-4788-bb3f-cfe3e209bdbb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:21.872745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:21.873603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:21.873874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:21.874134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] PATH_INFO: `/v3/projects/0561028808054431a1776a5d314367e9` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:21.875339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0561028808054431a1776a5d314367e9)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:21.877282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:21.926773 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0561028808054431a1776a5d314367e9', 'request_id': 'req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.933614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0561028808054431a1776a5d314367e9', 'request_id': 'req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.939956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0561028808054431a1776a5d314367e9', 'request_id': 'req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.950119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] The token cache is being invalidate because project 0561028808054431a1776a5d314367e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:21.950404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.951084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-462ca2a0-c0e4-430d-a06c-a4cb15b7aed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:21.952665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1163/2301] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:21 2022] DELETE /identity/v3/projects/0561028808054431a1776a5d314367e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:21.958673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:21.959183 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:21.959297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:21.977704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:21.979085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:22.039008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1139/2302] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:22.047437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.047789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.048125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.066457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:22.067680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:22.075747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1164/2303] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:22.084872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.094955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674331d-d7a3-46c7-bb7c-0f2bfa249013 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.099716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.100369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.100646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.100917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.101644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:22:22.101945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.103606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.114824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1140/2304] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:22:22.119291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.128461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d876dfd-ab9a-4cac-9977-d15bf03e8f5e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.133961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.134615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.134920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.135186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.135858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.137757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.179783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1165/2305] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:22.185248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.196028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52eff48-eb44-4151-96c7-9ad320c95664 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.264060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.264733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.265009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.265278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.265962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.267959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.290621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1141/2306] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:22:22.296499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.307424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd41d52-0194-4d43-8232-8f4c49f7d05f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.313124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.313781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.314087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.314411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.315215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.316846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.326709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1166/2307] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:22.330754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.341041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ff566-f2a6-43e5-89f4-e9fe8852553c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.346747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35562c-eecd-4f7d-a640-b1faee5a05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.347439 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35562c-eecd-4f7d-a640-b1faee5a05b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.347717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35562c-eecd-4f7d-a640-b1faee5a05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.347985 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35562c-eecd-4f7d-a640-b1faee5a05b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.348704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35562c-eecd-4f7d-a640-b1faee5a05b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.350364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35562c-eecd-4f7d-a640-b1faee5a05b9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.360558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1142/2308] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:22.367077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.380376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2503-592b-46bf-b99d-dec81746596a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.385653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.386503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.386811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.387159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] PATH_INFO: `/v3/projects/201c74b32ae540ca98a7c6cd69ee4a6f/users/074c8bd267ee4203affc9e5e2780dc4f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.403202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=201c74b32ae540ca98a7c6cd69ee4a6f, user_id=074c8bd267ee4203affc9e5e2780dc4f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.405911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.421508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1167/2309] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:22 2022] PUT /identity/v3/projects/201c74b32ae540ca98a7c6cd69ee4a6f/users/074c8bd267ee4203affc9e5e2780dc4f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:22.433834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.434129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.434408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.461325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] MFA Rules not processed for user `074c8bd267ee4203affc9e5e2780dc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:22.462539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:22.533097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1143/2310] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:22.539980 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.605510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522ccd-d70c-4b1a-bbbf-79ff97a5a10e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.611162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.611928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.612202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.612466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.613138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.615097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.645957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1168/2311] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:22.650197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.661562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68731c-bff5-4da4-8f95-4682b8559eb6 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.729110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.729776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.730171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.730433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.731290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.733325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.753610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1144/2312] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:22.757488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.768218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc877089-3b1e-47a2-8f9c-67c171e4832c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.773252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.773910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.774188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.774457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.775215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.776832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.787990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1169/2313] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:22.791777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.802420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687616a-7228-4fc2-863d-86a86168c680 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.808891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.809761 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.810032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.810297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] PATH_INFO: `/v3/projects/ac69e458a422407eb0153be277f4e8ba/users/093218a4e73144eebcb51c30fcb16020/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.825830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac69e458a422407eb0153be277f4e8ba, user_id=093218a4e73144eebcb51c30fcb16020, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.828691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.843956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1145/2314] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:22 2022] PUT /identity/v3/projects/ac69e458a422407eb0153be277f4e8ba/users/093218a4e73144eebcb51c30fcb16020/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:22.848158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.858290 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6adf00-e585-4ee0-85ae-1404841fd6f0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.913297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cce5d4-0024-4b98-b21b-9fdae10ec4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.913954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce5d4-0024-4b98-b21b-9fdae10ec4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.914242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce5d4-0024-4b98-b21b-9fdae10ec4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.914501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cce5d4-0024-4b98-b21b-9fdae10ec4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.915244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cce5d4-0024-4b98-b21b-9fdae10ec4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.916868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cce5d4-0024-4b98-b21b-9fdae10ec4a6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.926733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1170/2315] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:22.931274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:22.942230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781394d8-7367-40e3-9d5e-052f150d05a5 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:22.947902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:22.948872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.949180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.949449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] PATH_INFO: `/v3/projects/ac69e458a422407eb0153be277f4e8ba/users/093218a4e73144eebcb51c30fcb16020/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:22.951916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac69e458a422407eb0153be277f4e8ba, user_id=093218a4e73144eebcb51c30fcb16020, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:22.954742 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:22.965563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1146/2316] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:22 2022] PUT /identity/v3/projects/ac69e458a422407eb0153be277f4e8ba/users/093218a4e73144eebcb51c30fcb16020/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:22.976801 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab58e5-0fe4-47d0-a138-e12c29bc577b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:22.977090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab58e5-0fe4-47d0-a138-e12c29bc577b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:22.977365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab58e5-0fe4-47d0-a138-e12c29bc577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:23.005294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d8ab58e5-0fe4-47d0-a138-e12c29bc577b None None] MFA Rules not processed for user `093218a4e73144eebcb51c30fcb16020`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:23.006504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d8ab58e5-0fe4-47d0-a138-e12c29bc577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:23.073442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1171/2317] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:23.084844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:23.086794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:23.150538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65b02c-74d7-4e49-9381-58480f501fdf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:23.154529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:23.155289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:23.155869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:23.156400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:23.214753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:23.216320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:23.225523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1147/2318] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:24.313626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:24.314153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:24.314153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:24.333310 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:24.334547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:24.390166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1172/2319] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:24.405507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:24.407376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:24.477643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c4f6d-542f-467e-b3e6-c20a49415fe5 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:24.483017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e169f6-5be7-416a-926a-189b73301f15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:24.483656 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e169f6-5be7-416a-926a-189b73301f15 service swift] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:24.483932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e169f6-5be7-416a-926a-189b73301f15 service swift] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:24.484184 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e169f6-5be7-416a-926a-189b73301f15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:24.492122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e169f6-5be7-416a-926a-189b73301f15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:24.493696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e169f6-5be7-416a-926a-189b73301f15 service swift] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:24.501641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1148/2320] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 08:22:25.795512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:25.862740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdce81c-9823-4836-b5ed-bf9b01faad78 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:25.867411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:25.868337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:25.868602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:25.868875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] PATH_INFO: `/v3/users/074c8bd267ee4203affc9e5e2780dc4f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:25.870100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074c8bd267ee4203affc9e5e2780dc4f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:25.872213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:25.925088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074c8bd267ee4203affc9e5e2780dc4f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:25.951085 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074c8bd267ee4203affc9e5e2780dc4f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:25.962256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074c8bd267ee4203affc9e5e2780dc4f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:25.963381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074c8bd267ee4203affc9e5e2780dc4f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:25.964033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074c8bd267ee4203affc9e5e2780dc4f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:25.984479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1173/2321] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:25 2022] DELETE /identity/v3/users/074c8bd267ee4203affc9e5e2780dc4f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:25.989293 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:25.989848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:25.989848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:26.007924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:26.009133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:26.072410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1149/2322] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:26.083905 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:26.085323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:26.148160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5e445-7881-4e6a-a055-129089d8c514 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:26.152252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:26.152923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:26.153219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:26.153463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:26.163818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:26.165260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:26.175610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1174/2323] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:26.492024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:26.493740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:26.509436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949054ef-bbd0-4ae9-b7fb-f3a7e3eab01c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:26.515907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:26.516875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:26.517159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:26.517488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] PATH_INFO: `/v3/projects/201c74b32ae540ca98a7c6cd69ee4a6f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:26.518704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201c74b32ae540ca98a7c6cd69ee4a6f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:26.520805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:26.579197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201c74b32ae540ca98a7c6cd69ee4a6f', 'request_id': 'req-600b748b-7817-434a-9509-80c2dc6d10e5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.585643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201c74b32ae540ca98a7c6cd69ee4a6f', 'request_id': 'req-600b748b-7817-434a-9509-80c2dc6d10e5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.595859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201c74b32ae540ca98a7c6cd69ee4a6f', 'request_id': 'req-600b748b-7817-434a-9509-80c2dc6d10e5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.609203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] The token cache is being invalidate because project 201c74b32ae540ca98a7c6cd69ee4a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:26.609203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.610027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.614999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1150/2324] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:26 2022] DELETE /identity/v3/projects/201c74b32ae540ca98a7c6cd69ee4a6f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:26.616135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:26.628400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbd991-78bb-4a0d-97dd-1c83caae4d33 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:26.692261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:26.692955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:26.693221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:26.693492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] PATH_INFO: `/v3/users/093218a4e73144eebcb51c30fcb16020` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:26.694704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] RBAC: Authorizing `identity:delete_user(user_id=093218a4e73144eebcb51c30fcb16020)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:26.696893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:26.775069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093218a4e73144eebcb51c30fcb16020'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.786182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093218a4e73144eebcb51c30fcb16020'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.797608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093218a4e73144eebcb51c30fcb16020'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.799229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093218a4e73144eebcb51c30fcb16020'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.804552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-441ccd55-1f6e-43af-ad3e-028383c2195b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093218a4e73144eebcb51c30fcb16020'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:26.845172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1175/2325] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:26 2022] DELETE /identity/v3/users/093218a4e73144eebcb51c30fcb16020 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:27.216878 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.219869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:27.239135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b748b-7817-434a-9509-80c2dc6d10e5 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.307702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.308914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.309193 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.309466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] PATH_INFO: `/v3/projects/ac69e458a422407eb0153be277f4e8ba` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.310759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac69e458a422407eb0153be277f4e8ba)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.313089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.365895 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac69e458a422407eb0153be277f4e8ba', 'request_id': 'req-58b5a0b2-560a-418d-a956-6119f709f7c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:27.372926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac69e458a422407eb0153be277f4e8ba', 'request_id': 'req-58b5a0b2-560a-418d-a956-6119f709f7c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:27.382714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac69e458a422407eb0153be277f4e8ba', 'request_id': 'req-58b5a0b2-560a-418d-a956-6119f709f7c3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:27.394004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] The token cache is being invalidate because project ac69e458a422407eb0153be277f4e8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:27.394291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:27.394973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-58b5a0b2-560a-418d-a956-6119f709f7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:27.396791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1151/2326] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:27 2022] DELETE /identity/v3/projects/ac69e458a422407eb0153be277f4e8ba => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:27.402105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.402105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.402804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.425368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:27.426946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:27.493831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1176/2327] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:22:27.503089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.503517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.506976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.534988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:27.536267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:27.545643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1152/2328] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:27.549100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.562982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467638ff-1122-4b3c-a8f5-d00ea29d4fb6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.568868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.569554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.569836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.570109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.570839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:22:27.571180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.572797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.589447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1177/2329] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:22:27.593928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.606939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc3ce1-8526-4261-9585-37a8e828e5c3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.614534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.615254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.615536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.615945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.616511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.620489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.652158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1153/2330] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:27 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:27.656313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.667270 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bce1b-ba96-4ace-aac6-ebfc231d575b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.732927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.733706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.733989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.734262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.735009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.737389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.762421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1178/2331] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:27 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:27.765921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.776537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2b743-bdc8-4518-a2f6-aa08cf4e382b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.783697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.784408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.784681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.784949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.785688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.787371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.800787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1154/2332] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:22:27.805033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.816671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b0a9-885c-480d-849b-8800ca9c703c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.822100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bef2c3-9217-493f-8812-bb40b367ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.822957 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bef2c3-9217-493f-8812-bb40b367ffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.823246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bef2c3-9217-493f-8812-bb40b367ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.823529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bef2c3-9217-493f-8812-bb40b367ffb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.824273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bef2c3-9217-493f-8812-bb40b367ffb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.825949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bef2c3-9217-493f-8812-bb40b367ffb6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.841864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1179/2333] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:27.845956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:27.860126 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2d331-ee99-486b-ba5a-464c5bef8c1e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:27.869241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:27.870371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.870848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.871152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] PATH_INFO: `/v3/projects/3c3c07719a82443a8622ac3595d8ef7e/users/73fa0e78d7194cd7b34f69a5a0ab277d/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.888926 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c3c07719a82443a8622ac3595d8ef7e, user_id=73fa0e78d7194cd7b34f69a5a0ab277d, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:27.892455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:27.910310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1155/2334] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:27 2022] PUT /identity/v3/projects/3c3c07719a82443a8622ac3595d8ef7e/users/73fa0e78d7194cd7b34f69a5a0ab277d/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:27.921265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:27.922485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:27.924441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:27.976140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] MFA Rules not processed for user `73fa0e78d7194cd7b34f69a5a0ab277d`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:27.977383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:28.053258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1180/2335] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:28.057624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.127301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fcb6c-9fc5-412f-8c62-ee4879a796ab admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.139777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.140469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.140752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.141028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.141744 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.144331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.191882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1156/2336] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:28 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:28.192933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.217219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24b512-93fc-4216-b97a-54376aca43c6 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.289237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.290145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.290485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.290760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.291653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.294345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.330377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1181/2337] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:28 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:28.331532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.346750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e3129-a30b-4282-a83d-2f08bd71d43a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.359811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.360529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.360808 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.361130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.361900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.363673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.378210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1157/2338] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:22:28.379909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.391639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30e4c-8546-4886-a8f7-676c9bdb416d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.400325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fb806-0fb5-4f47-8be2-2a78a9243272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.402920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb806-0fb5-4f47-8be2-2a78a9243272 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.402920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb806-0fb5-4f47-8be2-2a78a9243272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.402920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fb806-0fb5-4f47-8be2-2a78a9243272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.402920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fb806-0fb5-4f47-8be2-2a78a9243272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.404467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fb806-0fb5-4f47-8be2-2a78a9243272 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.419695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1182/2339] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:22:28.424215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.436065 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5565dc-92b4-41eb-a5dd-da81f71732f5 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.440821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.441716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.441988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.442255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] PATH_INFO: `/v3/projects/7deffdc6b50a4a92a0cc91e86a624b63/users/178b09aa3a2a44eca3f5786d70cd72ae/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.461771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7deffdc6b50a4a92a0cc91e86a624b63, user_id=178b09aa3a2a44eca3f5786d70cd72ae, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.464838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.495499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1158/2340] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:28 2022] PUT /identity/v3/projects/7deffdc6b50a4a92a0cc91e86a624b63/users/178b09aa3a2a44eca3f5786d70cd72ae/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:28.552821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.553106 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.553384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.583294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] MFA Rules not processed for user `178b09aa3a2a44eca3f5786d70cd72ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:28.584764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:28.660508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1183/2341] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:28.664950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.732072 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aa59e-e07b-4abe-9df1-28b3aef07411 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.737495 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.738250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.738530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.738800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.739604 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.741609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.777120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1159/2342] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:28 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:28.778639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.793614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb544a-9874-4c21-ba98-9c63b4d6df9c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.859899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.860639 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.860874 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.861182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.861890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.863999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.884959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1184/2343] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:28 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:28.889109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.901888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f99788-b342-4695-a807-39e4472d5d11 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.911924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.912677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.912963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.913245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.914008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.915771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.930924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1160/2344] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:28.932386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:28.944841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486fc06-c387-4a12-9a8d-e426f6f5ab46 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:28.951669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:28.952616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:28.952896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:28.953250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] PATH_INFO: `/v3/projects/d6ff26538d2f4c6aa879a3a41b87878b/users/eac2ea5cf5e74809b369d8b635fa4760/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:28.976138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ff26538d2f4c6aa879a3a41b87878b, user_id=eac2ea5cf5e74809b369d8b635fa4760, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:28.977728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:28.994965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1185/2345] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:28 2022] PUT /identity/v3/projects/d6ff26538d2f4c6aa879a3a41b87878b/users/eac2ea5cf5e74809b369d8b635fa4760/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:28.998358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:29.008724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75146cfb-0fca-4656-ab7f-eab258613bfe admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:29.070423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db5325-ac68-40b8-bee9-494e2ae7f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:29.070697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5325-ac68-40b8-bee9-494e2ae7f5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:29.071063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5325-ac68-40b8-bee9-494e2ae7f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:29.071465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db5325-ac68-40b8-bee9-494e2ae7f5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:29.072320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5325-ac68-40b8-bee9-494e2ae7f5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:29.074173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db5325-ac68-40b8-bee9-494e2ae7f5e8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:29.092187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1161/2346] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:29.093399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:29.108772 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5fc78-7755-4f66-a117-b201e5846453 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:29.115532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:29.115532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:29.115532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:29.115532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] PATH_INFO: `/v3/projects/d6ff26538d2f4c6aa879a3a41b87878b/users/eac2ea5cf5e74809b369d8b635fa4760/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:29.118386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ff26538d2f4c6aa879a3a41b87878b, user_id=eac2ea5cf5e74809b369d8b635fa4760, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:29.121090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:29.133512 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1186/2347] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:29 2022] PUT /identity/v3/projects/d6ff26538d2f4c6aa879a3a41b87878b/users/eac2ea5cf5e74809b369d8b635fa4760/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:29.143987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:29.144598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:29.145140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:29.179866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] MFA Rules not processed for user `eac2ea5cf5e74809b369d8b635fa4760`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:29.181408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:29.267068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1162/2348] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:29.279306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:29.283812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:29.349486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2173a1-4989-4409-a999-4029a5a6fea1 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:29.353535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:29.354294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:29.354673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:29.355342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:29.436628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:29.438107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:29.449844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1187/2349] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:31.077775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:31.079477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:31.092211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab0936-e4c6-4332-a992-eead493857e2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:31.095918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:31.096568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:31.096853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:31.097121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:31.159757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:31.160552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:31.170006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1163/2350] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:31.798599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:31.811822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879658f-666c-4585-9342-0c45c4f12938 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:31.826074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbf95e-4ed9-4f74-91b5-bf3ba04b61ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:31.827082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf95e-4ed9-4f74-91b5-bf3ba04b61ae service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:31.827452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf95e-4ed9-4f74-91b5-bf3ba04b61ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:31.827811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbf95e-4ed9-4f74-91b5-bf3ba04b61ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:31.842385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fbf95e-4ed9-4f74-91b5-bf3ba04b61ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:31.844205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fbf95e-4ed9-4f74-91b5-bf3ba04b61ae service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:31.862946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1188/2351] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:35.838990 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:35.908345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9fd0c-4e82-43a2-bc6a-c197124ddbbb service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:35.914172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:35.915057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:35.915334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:35.915602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] PATH_INFO: `/v3/users/73fa0e78d7194cd7b34f69a5a0ab277d` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:35.916791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73fa0e78d7194cd7b34f69a5a0ab277d)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:35.918708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:35.976306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73fa0e78d7194cd7b34f69a5a0ab277d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:35.985237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73fa0e78d7194cd7b34f69a5a0ab277d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:35.992495 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73fa0e78d7194cd7b34f69a5a0ab277d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:35.993117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73fa0e78d7194cd7b34f69a5a0ab277d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.004494 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73fa0e78d7194cd7b34f69a5a0ab277d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.010390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1164/2352] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:35 2022] DELETE /identity/v3/users/73fa0e78d7194cd7b34f69a5a0ab277d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:36.015214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:36.015727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:36.015727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:36.032492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:36.033655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:36.095110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1189/2353] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:36.106715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:36.109116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:36.179924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4f354-1050-435e-aef1-8af1b0d78c47 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:36.184531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:36.185180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:36.185459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:36.185768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:36.195149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:36.196578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:36.205834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1165/2354] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:36.474139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:36.475636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:36.493593 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c7e55-81ca-4f02-96d8-eecb5dce3f7a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:36.498616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:36.499669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:36.499828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:36.500041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] PATH_INFO: `/v3/projects/3c3c07719a82443a8622ac3595d8ef7e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:36.501398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c3c07719a82443a8622ac3595d8ef7e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:36.503871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:36.551558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3c07719a82443a8622ac3595d8ef7e', 'request_id': 'req-68767b19-b75c-40be-bf94-49d97f84db88'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.559932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3c07719a82443a8622ac3595d8ef7e', 'request_id': 'req-68767b19-b75c-40be-bf94-49d97f84db88'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.566358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3c07719a82443a8622ac3595d8ef7e', 'request_id': 'req-68767b19-b75c-40be-bf94-49d97f84db88'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.576607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] The token cache is being invalidate because project 3c3c07719a82443a8622ac3595d8ef7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:36.576897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.577531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.579132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1190/2355] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:36 2022] DELETE /identity/v3/projects/3c3c07719a82443a8622ac3595d8ef7e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:36.583076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:36.592560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c78cad-7c60-4965-9445-27414c5f2843 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:36.661182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:36.662076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:36.662356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:36.662628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] PATH_INFO: `/v3/users/178b09aa3a2a44eca3f5786d70cd72ae` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:36.663874 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=178b09aa3a2a44eca3f5786d70cd72ae)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:36.665825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:36.712750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178b09aa3a2a44eca3f5786d70cd72ae'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.721120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178b09aa3a2a44eca3f5786d70cd72ae'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.728130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178b09aa3a2a44eca3f5786d70cd72ae'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.728849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178b09aa3a2a44eca3f5786d70cd72ae'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.741841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178b09aa3a2a44eca3f5786d70cd72ae'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:36.749791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1166/2356] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:36 2022] DELETE /identity/v3/users/178b09aa3a2a44eca3f5786d70cd72ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:37.021560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:37.023175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:37.039121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68767b19-b75c-40be-bf94-49d97f84db88 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:37.100834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:37.102258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:37.102567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:37.103063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] PATH_INFO: `/v3/projects/7deffdc6b50a4a92a0cc91e86a624b63` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:37.104411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7deffdc6b50a4a92a0cc91e86a624b63)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:37.106364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:37.159606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7deffdc6b50a4a92a0cc91e86a624b63', 'request_id': 'req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.168011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7deffdc6b50a4a92a0cc91e86a624b63', 'request_id': 'req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.174823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7deffdc6b50a4a92a0cc91e86a624b63', 'request_id': 'req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.185866 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] The token cache is being invalidate because project 7deffdc6b50a4a92a0cc91e86a624b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:37.186153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.186912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.188739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1191/2357] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:37 2022] DELETE /identity/v3/projects/7deffdc6b50a4a92a0cc91e86a624b63 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:37.192691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:37.194207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:37.207304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493fe6-3059-4a7c-ac9c-edb10baeeaaf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:37.268672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:37.269592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:37.269864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:37.270137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] PATH_INFO: `/v3/users/eac2ea5cf5e74809b369d8b635fa4760` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:37.271346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac2ea5cf5e74809b369d8b635fa4760)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:37.273279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:37.323741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac2ea5cf5e74809b369d8b635fa4760'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.331877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac2ea5cf5e74809b369d8b635fa4760'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.339525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac2ea5cf5e74809b369d8b635fa4760'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.340095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac2ea5cf5e74809b369d8b635fa4760'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.353151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-83eed191-a51f-469e-bfcf-4c49aa5fefae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac2ea5cf5e74809b369d8b635fa4760'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.360390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1167/2358] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:37 2022] DELETE /identity/v3/users/eac2ea5cf5e74809b369d8b635fa4760 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:37.679077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:37.680815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:37.694746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e0d3e-dfe5-4f47-a3da-bf00abb57170 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:37.766416 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:37.767468 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:37.767818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:37.768156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] PATH_INFO: `/v3/projects/d6ff26538d2f4c6aa879a3a41b87878b` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:37.769367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ff26538d2f4c6aa879a3a41b87878b)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:37.771652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:37.823476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ff26538d2f4c6aa879a3a41b87878b', 'request_id': 'req-58fc404b-77f8-4c05-b025-729b455fcb70'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.838066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ff26538d2f4c6aa879a3a41b87878b', 'request_id': 'req-58fc404b-77f8-4c05-b025-729b455fcb70'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.845908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ff26538d2f4c6aa879a3a41b87878b', 'request_id': 'req-58fc404b-77f8-4c05-b025-729b455fcb70'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.858856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] The token cache is being invalidate because project d6ff26538d2f4c6aa879a3a41b87878b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:37.859280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.860174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-58fc404b-77f8-4c05-b025-729b455fcb70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:37.863047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1192/2359] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:37 2022] DELETE /identity/v3/projects/d6ff26538d2f4c6aa879a3a41b87878b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:37.867818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:37.868111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:37.868388 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:37.887964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:37.889267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:37.964412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1168/2360] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:37.974049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:37.974384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:37.974601 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:37.996291 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:37.997506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:38.006978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1193/2361] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:38.016022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.028035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cab4b-07df-46cc-b035-024c7067deaa None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.033830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.034527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.034797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.035113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.035855 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:22:38.036160 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.038519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.055986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1169/2362] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:22:38.057318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.074370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1ba2a-d2c0-4443-b510-a89b082fd3d7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.080994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.081678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.082019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.082262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.083548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.085662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.115841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1194/2363] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:38 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:38.119866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.130236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105f451-228b-4314-8d8b-44e93c321dbd admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.199546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.200318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.200504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.200771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.201503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.203616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.231050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1170/2364] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:38 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:38.233209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.243805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac308f0-6677-4b86-9865-1bafa1189f56 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.249056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.249713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.249987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.250251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.250997 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.252654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.263475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1195/2365] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:22:38.267756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.279703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7408-9c42-4a6d-a5e2-824c9b43dd17 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.284479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26912d30-9a66-4555-a48e-8455b28df4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.285154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26912d30-9a66-4555-a48e-8455b28df4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.285498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26912d30-9a66-4555-a48e-8455b28df4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.285766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26912d30-9a66-4555-a48e-8455b28df4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.286492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26912d30-9a66-4555-a48e-8455b28df4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.288171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26912d30-9a66-4555-a48e-8455b28df4f6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.299195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1171/2366] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:38.303628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.314718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8fad-799a-4b44-83e5-d9bfbe242fd6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.322973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.323965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.324343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.324682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] PATH_INFO: `/v3/projects/ed72ec7eb5cc448ba1975c5078f3921a/users/9d9d0a2e15924eb19bd3ecaf9811c849/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.340896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed72ec7eb5cc448ba1975c5078f3921a, user_id=9d9d0a2e15924eb19bd3ecaf9811c849, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.343707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.358499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1196/2367] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:38 2022] PUT /identity/v3/projects/ed72ec7eb5cc448ba1975c5078f3921a/users/9d9d0a2e15924eb19bd3ecaf9811c849/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:38.369187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238c14-e9db-4a34-9a3f-c1a01e0b8779 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.369477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238c14-e9db-4a34-9a3f-c1a01e0b8779 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.369767 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238c14-e9db-4a34-9a3f-c1a01e0b8779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.401664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-19238c14-e9db-4a34-9a3f-c1a01e0b8779 None None] MFA Rules not processed for user `9d9d0a2e15924eb19bd3ecaf9811c849`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:38.403008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-19238c14-e9db-4a34-9a3f-c1a01e0b8779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:38.466367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1172/2368] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:38.477908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.479678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:38.537970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1487d-a318-43f9-b3ea-a0169edfcacb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.541828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf40f2-333e-412b-a79e-d24e83ea49ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.542471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf40f2-333e-412b-a79e-d24e83ea49ba service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.542743 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf40f2-333e-412b-a79e-d24e83ea49ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.543053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf40f2-333e-412b-a79e-d24e83ea49ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.552391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf40f2-333e-412b-a79e-d24e83ea49ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.553846 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf40f2-333e-412b-a79e-d24e83ea49ba service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:38.566697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1197/2369] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:38.775780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3698d-1097-4dcd-8b52-88c778a14d2d None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.776196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3698d-1097-4dcd-8b52-88c778a14d2d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.776740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3698d-1097-4dcd-8b52-88c778a14d2d None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.778925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1173/2370] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:22:38.785963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525dbe9-cad5-4925-b7fc-6fb50023f46d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.786251 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525dbe9-cad5-4925-b7fc-6fb50023f46d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.786549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525dbe9-cad5-4925-b7fc-6fb50023f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.807433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7525dbe9-cad5-4925-b7fc-6fb50023f46d None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:38.808876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7525dbe9-cad5-4925-b7fc-6fb50023f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:38.889350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1198/2371] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:22:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:38.903483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3698d-1097-4dcd-8b52-88c778a14d2d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:38.905247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3bb3698d-1097-4dcd-8b52-88c778a14d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:38.979358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3698d-1097-4dcd-8b52-88c778a14d2d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:38.982843 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df967d-30fe-497a-9846-90cd991e8f33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:38.983521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df967d-30fe-497a-9846-90cd991e8f33 service glance] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:38.983802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df967d-30fe-497a-9846-90cd991e8f33 service glance] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:38.984073 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df967d-30fe-497a-9846-90cd991e8f33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:38.994049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df967d-30fe-497a-9846-90cd991e8f33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:38.995522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df967d-30fe-497a-9846-90cd991e8f33 service glance] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:39.006112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1174/2372] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:22:39.080246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bfb87-7453-490e-bb06-6d4d3c848f8f None None] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:39.080841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bfb87-7453-490e-bb06-6d4d3c848f8f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:39.080841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bfb87-7453-490e-bb06-6d4d3c848f8f None None] PATH_INFO: `/` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:39.082159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1199/2373] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 08:22:39.087155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7595e97-b4e6-4595-a2cd-a9173a5e5593 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:39.087433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7595e97-b4e6-4595-a2cd-a9173a5e5593 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:39.087711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7595e97-b4e6-4595-a2cd-a9173a5e5593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:39.105733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d7595e97-b4e6-4595-a2cd-a9173a5e5593 None None] MFA Rules not processed for user `446b8ea1e1a44ab6b6b2cd4ca5a77b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:39.106950 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d7595e97-b4e6-4595-a2cd-a9173a5e5593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:39.160859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1175/2374] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:22:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:39.172595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bfb87-7453-490e-bb06-6d4d3c848f8f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:39.174442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-908bfb87-7453-490e-bb06-6d4d3c848f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:39.195179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bfb87-7453-490e-bb06-6d4d3c848f8f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:39.198546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0b498-10bf-4dfe-9ee2-25cac52ba171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:39.199218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0b498-10bf-4dfe-9ee2-25cac52ba171 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:39.199495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0b498-10bf-4dfe-9ee2-25cac52ba171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:39.199765 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0b498-10bf-4dfe-9ee2-25cac52ba171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:39.206694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0b498-10bf-4dfe-9ee2-25cac52ba171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:39.208187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0b498-10bf-4dfe-9ee2-25cac52ba171 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:39.215678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1200/2375] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:39.307937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50226dcb-e013-42cd-8b40-9722c73086ae None None] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:39.308454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50226dcb-e013-42cd-8b40-9722c73086ae None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:39.308454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50226dcb-e013-42cd-8b40-9722c73086ae None None] PATH_INFO: `/` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:39.309852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1176/2376] 10.222.0.59 () {54 vars in 921 bytes} [Wed May 4 08:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 08:22:39.316861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab160156-2428-480d-8e06-622496ab0764 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:39.317136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab160156-2428-480d-8e06-622496ab0764 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:39.317412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab160156-2428-480d-8e06-622496ab0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:39.335708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ab160156-2428-480d-8e06-622496ab0764 None None] MFA Rules not processed for user `268f6afa0af84c6b9a6807975bb8db87`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:39.336984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ab160156-2428-480d-8e06-622496ab0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:39.346209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1201/2377] 10.222.0.59 () {58 vars in 1018 bytes} [Wed May 4 08:22:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:22:39.360016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50226dcb-e013-42cd-8b40-9722c73086ae None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:39.372075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50226dcb-e013-42cd-8b40-9722c73086ae None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:39.376051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867b587-b3b2-4bcc-ad68-3f9f558f5561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:39.376783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b587-b3b2-4bcc-ad68-3f9f558f5561 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:39.377082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b587-b3b2-4bcc-ad68-3f9f558f5561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:39.377341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b587-b3b2-4bcc-ad68-3f9f558f5561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:39.388035 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867b587-b3b2-4bcc-ad68-3f9f558f5561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:39.389504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867b587-b3b2-4bcc-ad68-3f9f558f5561 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:39.400593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1177/2378] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:41.150093 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab160156-2428-480d-8e06-622496ab0764 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:41.224596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab160156-2428-480d-8e06-622496ab0764 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:41.230583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:41.231500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:41.231902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:41.232180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] PATH_INFO: `/v3/users/9d9d0a2e15924eb19bd3ecaf9811c849` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:41.233431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9d0a2e15924eb19bd3ecaf9811c849)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:41.235446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:41.290259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9d0a2e15924eb19bd3ecaf9811c849'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:41.298076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9d0a2e15924eb19bd3ecaf9811c849'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:41.305497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9d0a2e15924eb19bd3ecaf9811c849'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:41.306110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9d0a2e15924eb19bd3ecaf9811c849'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:41.306706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9d0a2e15924eb19bd3ecaf9811c849'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:41.322975 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1202/2379] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:22:41 2022] DELETE /identity/v3/users/9d9d0a2e15924eb19bd3ecaf9811c849 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:41.327555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:41.328032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:41.328138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:41.345143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:41.346379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:41.405265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1178/2380] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:22:41.415186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:41.416775 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:41.462469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:41.463910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:41.491357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958edca-f87f-48fe-8179-b2c9d90cc6f2 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:41.496197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860283f2-e22f-493f-8535-d574a01df848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:41.497028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860283f2-e22f-493f-8535-d574a01df848 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:41.497313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860283f2-e22f-493f-8535-d574a01df848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:41.497590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860283f2-e22f-493f-8535-d574a01df848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:41.508580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860283f2-e22f-493f-8535-d574a01df848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:41.510406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860283f2-e22f-493f-8535-d574a01df848 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:41.522617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1203/2381] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:41.541007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197db132-8b29-4d7c-b341-709cbbdd71f2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:41.546525 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:41.548042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:41.548762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:41.549345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:41.553838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:41.647655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:41.649243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:41.659376 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1179/2382] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:22:41.741567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:41.742261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:41.742858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:41.766705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:41.768540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:41.837220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1204/2383] 10.222.0.59 () {58 vars in 1009 bytes} [Wed May 4 08:22:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:41.854548 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:41.855877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:41.970639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bfe46-dbaa-4d5d-8eb2-d2f9417a718e service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:41.977021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931332-f547-4e68-bf17-7495d5f10de5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:41.977891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931332-f547-4e68-bf17-7495d5f10de5 service swift] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:41.978170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931332-f547-4e68-bf17-7495d5f10de5 service swift] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:41.978443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931332-f547-4e68-bf17-7495d5f10de5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:41.987669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931332-f547-4e68-bf17-7495d5f10de5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:41.989524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931332-f547-4e68-bf17-7495d5f10de5 service swift] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:41.998391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1180/2384] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:22:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 08:22:42.084321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.085788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:42.111899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942515-31ef-4866-bb16-806eddc50b32 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.119871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.120753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.121386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.121804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] PATH_INFO: `/v3/projects/ed72ec7eb5cc448ba1975c5078f3921a` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.129102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed72ec7eb5cc448ba1975c5078f3921a)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.131321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.232492 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed72ec7eb5cc448ba1975c5078f3921a', 'request_id': 'req-b586f4bc-709a-4729-af01-69845a94d30e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:42.242285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed72ec7eb5cc448ba1975c5078f3921a', 'request_id': 'req-b586f4bc-709a-4729-af01-69845a94d30e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:42.249259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed72ec7eb5cc448ba1975c5078f3921a', 'request_id': 'req-b586f4bc-709a-4729-af01-69845a94d30e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:42.262383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] The token cache is being invalidate because project ed72ec7eb5cc448ba1975c5078f3921a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:22:42.267082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:42.269510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b586f4bc-709a-4729-af01-69845a94d30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:22:42.275731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1205/2385] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:22:42 2022] DELETE /identity/v3/projects/ed72ec7eb5cc448ba1975c5078f3921a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:22:42.280711 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.280998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.281275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.309570 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:42.310765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:42.387240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1181/2386] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:42.395183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.395472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.395750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.443474 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:42.444709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:42.464757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1206/2387] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:42.469780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.484134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193ce2-afdb-42a1-a293-cb8c9c55cb52 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.499963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.501050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.502204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.503031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.504286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:22:42.504753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.506543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.527601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1182/2388] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:22:42.531981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.545587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d150e0c-21f5-4d89-a4ff-8fcd8841a0be None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.556304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.556985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.557264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.557536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.558244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.560517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.610916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1207/2389] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:22:42 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:42.616283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.629300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b755e-36aa-4932-be43-16af0d94af58 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.693155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.694084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.694437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.694770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.695537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.697651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.722608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1183/2390] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:22:42 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:22:42.723993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.734186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c94e6e-41b7-49f3-8583-293755a68e69 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.739293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.740061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.740277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.740611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.741277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.742903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.754315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1208/2391] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:42.758206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.768561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a6b69-a743-4cb4-9ccc-61f426be02b0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.773710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c1f4e-0338-46cc-9d3f-bd5f3288bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.774416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c1f4e-0338-46cc-9d3f-bd5f3288bdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.774693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c1f4e-0338-46cc-9d3f-bd5f3288bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.774998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c1f4e-0338-46cc-9d3f-bd5f3288bdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.775726 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c1f4e-0338-46cc-9d3f-bd5f3288bdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.777356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c1f4e-0338-46cc-9d3f-bd5f3288bdf6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.790252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1184/2392] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:22:42.792019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.803465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2b27e-b14e-4033-9060-654bfdfc88b8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:42.808278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:42.809164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.809441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.809730 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] PATH_INFO: `/v3/projects/d0ad5d350a8241adbce3fa8f9c77632c/users/c473be73cf814903b46d7d95182c5838/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.825052 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ad5d350a8241adbce3fa8f9c77632c, user_id=c473be73cf814903b46d7d95182c5838, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:42.828580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:42.843060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1209/2393] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:22:42 2022] PUT /identity/v3/projects/d0ad5d350a8241adbce3fa8f9c77632c/users/c473be73cf814903b46d7d95182c5838/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:22:42.848682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04259-9333-4c95-a9d6-3c4f4e1b7dc6 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:42.849176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04259-9333-4c95-a9d6-3c4f4e1b7dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:42.849554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04259-9333-4c95-a9d6-3c4f4e1b7dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:42.870534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-86b04259-9333-4c95-a9d6-3c4f4e1b7dc6 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:42.871814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-86b04259-9333-4c95-a9d6-3c4f4e1b7dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:42.941615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1185/2394] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:42.948740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:42.950673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:43.008060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17136-a178-4c2a-8d85-4c393f0ae2a5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:43.012049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:43.012907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:43.013181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:43.013451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:43.023054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:43.024488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:43.034817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1210/2395] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:43.854654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252d15-ccfe-4259-961a-b3740fac0e7f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:43.855328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252d15-ccfe-4259-961a-b3740fac0e7f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:43.855328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252d15-ccfe-4259-961a-b3740fac0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:43.884724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7b252d15-ccfe-4259-961a-b3740fac0e7f None None] MFA Rules not processed for user `c473be73cf814903b46d7d95182c5838`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:43.885979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7b252d15-ccfe-4259-961a-b3740fac0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:43.953535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1186/2396] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:43.964455 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:43.966092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:44.052283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16200930-3943-45a7-b0f0-7d301cf3fba6 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:44.056305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce0d7c-d9e2-4dec-926c-491a90e5644a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:44.057200 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0d7c-d9e2-4dec-926c-491a90e5644a service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:44.057478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0d7c-d9e2-4dec-926c-491a90e5644a service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:44.057879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce0d7c-d9e2-4dec-926c-491a90e5644a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:44.072585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce0d7c-d9e2-4dec-926c-491a90e5644a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:44.074058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce0d7c-d9e2-4dec-926c-491a90e5644a service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:44.087323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1211/2397] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:45.556703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:45.557248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:45.557248 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:45.576601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] MFA Rules not processed for user `c473be73cf814903b46d7d95182c5838`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:45.578590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:45.586765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1187/2398] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:49.838654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a352-3137-4eeb-ad72-2094854fdbd1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:49.839271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a352-3137-4eeb-ad72-2094854fdbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:49.839271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a352-3137-4eeb-ad72-2094854fdbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:49.857155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8991a352-3137-4eeb-ad72-2094854fdbd1 None None] MFA Rules not processed for user `599e6fd88ed348eab5de9a6330daf477`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:49.858478 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8991a352-3137-4eeb-ad72-2094854fdbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:49.931973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1212/2399] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:50.470723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:50.472415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:50.485673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984e795-fa01-41b7-9465-1a33530b3de2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:50.489862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:50.490586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:50.490861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:50.491162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:50.493048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:50.505800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:50.507298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:50.516501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1188/2400] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:22:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:22:57.436041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:57.436561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:57.436682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:57.456491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] MFA Rules not processed for user `389b4a32ee1543f0a5111eea5e4b6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:22:57.457768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:57.550049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1213/2401] 10.222.0.59 () {58 vars in 967 bytes} [Wed May 4 08:22:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:22:57.560558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:22:57.561959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:22:57.629225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbb901-19fd-4587-8ef7-55cc9e172419 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:22:57.635344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fce6f00e1a97411fa0c248a8f08b2256', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:22:57.636162 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:22:57.636492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:22:57.636854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:22:57.656455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:22:57.658603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:22:57.671610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1189/2402] 10.222.0.59 () {60 vars in 1384 bytes} [Wed May 4 08:22:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 08:23:17.625168 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:17.634505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac608e2-d5ba-4b95-9a7a-c3ebb590648b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:17.638244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:17.638906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:17.639193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:17.639498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:17.641398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:17.705395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:17.706799 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:17.716738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1214/2403] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:23.909729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:23.920842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042ce3-1eec-4221-9e12-07a8c5835ad0 service swift] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:23.924803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:23.925795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:23.926076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:23.926350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:23.928349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:23.940943 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:23.942382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:23.952684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1190/2404] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:27.784841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:27.786391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:27.802669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0231ca-6e2c-44ef-9c1c-b3385f5beb7b service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:27.807608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:27.808483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:27.808761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:27.809025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] PATH_INFO: `/v3/users/090f701bb7e54a72ab9a5c84fba01fc2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:27.810188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090f701bb7e54a72ab9a5c84fba01fc2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:27.812133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:27.861071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090f701bb7e54a72ab9a5c84fba01fc2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:27.868826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090f701bb7e54a72ab9a5c84fba01fc2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:27.875927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090f701bb7e54a72ab9a5c84fba01fc2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:27.876539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090f701bb7e54a72ab9a5c84fba01fc2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:27.877144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f7385f46-f802-40ef-94f9-3d80c082d4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090f701bb7e54a72ab9a5c84fba01fc2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:27.894697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1215/2405] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:27 2022] DELETE /identity/v3/users/090f701bb7e54a72ab9a5c84fba01fc2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:28.085415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.096679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76136cb-c6cd-4d48-a012-a55da4d0abd1 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.153225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.154059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.154336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.154600 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] PATH_INFO: `/v3/projects/49d87bce57a4470d85b4df9b85eb9602` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.155814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d87bce57a4470d85b4df9b85eb9602)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.157769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.217920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d87bce57a4470d85b4df9b85eb9602', 'request_id': 'req-fb64b197-8aed-4514-a576-ce568414a13a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:28.224253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d87bce57a4470d85b4df9b85eb9602', 'request_id': 'req-fb64b197-8aed-4514-a576-ce568414a13a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:28.232756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d87bce57a4470d85b4df9b85eb9602', 'request_id': 'req-fb64b197-8aed-4514-a576-ce568414a13a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:28.243140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] The token cache is being invalidate because project 49d87bce57a4470d85b4df9b85eb9602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:28.243424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:28.244021 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-fb64b197-8aed-4514-a576-ce568414a13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:28.248650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1191/2406] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:28 2022] DELETE /identity/v3/projects/49d87bce57a4470d85b4df9b85eb9602 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:28.253791 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.254077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.254372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.271713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:28.272929 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:28.333665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1216/2407] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:28.341712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.342016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.342266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.360916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:28.362101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:28.370515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1192/2408] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:28.375055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.385115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080372c-5ff5-4334-bc5e-c2fea6153389 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.390690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.391384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.391659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.391928 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.392653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:28.392949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.394570 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.406789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1217/2409] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:28.411156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.420731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c4f9-28ac-4b3a-83ab-2bc03899dd87 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.426109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.426768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.427236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.427511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.428205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.430110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.457343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1193/2410] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:28.461600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.471990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5faab-b3f1-4c63-bba8-67f7f325719b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.532006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.532673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.532959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.533222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.533897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.535877 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.560654 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1218/2411] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:28.562941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.573625 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f791662-ecfc-4fd1-b1f7-0714cb60ddee admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.578310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.579008 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.579290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.579565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.580338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.581917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.593999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1194/2412] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:28.598893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.609388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be23d0e-a209-4442-9c92-2812b0503a2b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.614337 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a3c4f-7167-41d3-90d6-cd414f38bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.615182 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3c4f-7167-41d3-90d6-cd414f38bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.615526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3c4f-7167-41d3-90d6-cd414f38bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.615861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a3c4f-7167-41d3-90d6-cd414f38bc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.616620 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a3c4f-7167-41d3-90d6-cd414f38bc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.618221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a3c4f-7167-41d3-90d6-cd414f38bc5c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.632360 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1219/2413] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:28.633516 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.644076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c756c-7c8c-4049-bcf6-7fac59dadae0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.649546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.650422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.650700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.650998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] PATH_INFO: `/v3/projects/0005e6247b2745149e94379cc3148195/users/817307c704b94208be9ebf6d3a043c1f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.667339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0005e6247b2745149e94379cc3148195, user_id=817307c704b94208be9ebf6d3a043c1f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.671562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.688232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1195/2414] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:28 2022] PUT /identity/v3/projects/0005e6247b2745149e94379cc3148195/users/817307c704b94208be9ebf6d3a043c1f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:28.699985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.700276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.700547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.726218 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] MFA Rules not processed for user `817307c704b94208be9ebf6d3a043c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:28.727444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:28.797698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1220/2415] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:28.802598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.866308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef98e-9809-4720-92de-1c5aa700e41e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.871811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.872468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.872762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.873025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.873712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.875681 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:28.904900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1196/2416] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:28.909591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:28.921538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d207c50-6c3e-4ba0-a719-2f0d97448d33 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:28.977453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:28.978121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:28.978398 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:28.978697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:28.979434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:28.981355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.004353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1221/2417] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:28 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:29.005598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:29.016545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cbead0-880b-41e4-bf8f-f9461391bc0b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:29.022954 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:29.023592 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.023875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.024493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.024945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:29.026612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.037791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1197/2418] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:29.042057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:29.052783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770a283-92b8-43ec-adc4-f60037a76b14 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:29.057959 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:29.058833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.059141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.059406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] PATH_INFO: `/v3/projects/49a67b36ec494e0d8b8769d513053875/users/5d5c4b4a9d644501b72d1ea550ef940d/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.075094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a67b36ec494e0d8b8769d513053875, user_id=5d5c4b4a9d644501b72d1ea550ef940d, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:29.077819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.093285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1222/2419] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:29 2022] PUT /identity/v3/projects/49a67b36ec494e0d8b8769d513053875/users/5d5c4b4a9d644501b72d1ea550ef940d/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:29.098027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:29.113018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04eb6c5-17cf-4aa6-8bac-fa30ed79d27b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:29.173749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380608b-645e-4d40-9699-576fd5cc5b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:29.174328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380608b-645e-4d40-9699-576fd5cc5b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.174629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380608b-645e-4d40-9699-576fd5cc5b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.174910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380608b-645e-4d40-9699-576fd5cc5b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.175921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380608b-645e-4d40-9699-576fd5cc5b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:29.177653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380608b-645e-4d40-9699-576fd5cc5b64 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.187603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1198/2420] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:29.193413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:29.203665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b83e1-339f-4cd4-b444-563aae01823b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:29.208392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:29.209261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.209538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.209816 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] PATH_INFO: `/v3/projects/49a67b36ec494e0d8b8769d513053875/users/5d5c4b4a9d644501b72d1ea550ef940d/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.211827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a67b36ec494e0d8b8769d513053875, user_id=5d5c4b4a9d644501b72d1ea550ef940d, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:29.214482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.225147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1223/2421] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:29 2022] PUT /identity/v3/projects/49a67b36ec494e0d8b8769d513053875/users/5d5c4b4a9d644501b72d1ea550ef940d/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:29.236399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.236689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.236986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.263488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] MFA Rules not processed for user `5d5c4b4a9d644501b72d1ea550ef940d`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:29.264775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:29.333918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1199/2422] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:29.345701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:29.347564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:29.413402 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc425c2-8033-4a93-8f00-d5ce79bc01df admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:29.419716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:29.420462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.420746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.421015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.435499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:29.437833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.450056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1224/2423] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:29.530098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:29.540827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b36473-fcb7-46d1-b7a7-58c163b5aa2a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:29.545357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:29.545997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:29.546445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:29.546719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:29.603973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:29.605385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:29.614559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1200/2424] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:30.973952 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:30.975531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:31.045445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbf6cc-e2cd-4951-8fc5-a02dfbc44ca7 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:31.049519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:31.050165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:31.050752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:31.051206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:31.053327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:31.145852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:31.147296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:31.158992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1225/2425] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:34.240602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:34.242017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:34.255822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785242c7-45e2-4aa8-a004-c06f7a601600 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:34.260635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:34.261633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.261983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.262326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] PATH_INFO: `/v3/users/2112f845ab0347b099ead44c05a71785` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.263749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2112f845ab0347b099ead44c05a71785)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:34.265959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:34.316027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2112f845ab0347b099ead44c05a71785'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.325759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2112f845ab0347b099ead44c05a71785'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.333690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2112f845ab0347b099ead44c05a71785'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.334361 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2112f845ab0347b099ead44c05a71785'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.345598 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a919c26d-9fe9-4527-ba5e-ac1eeba9f9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2112f845ab0347b099ead44c05a71785'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.351328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1201/2426] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:34 2022] DELETE /identity/v3/users/2112f845ab0347b099ead44c05a71785 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:34.526491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:34.536341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57803cac-f20e-4a8e-bb1d-4ce5654ca0e2 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:34.592366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:34.593234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.593511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.593777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] PATH_INFO: `/v3/projects/57ccec31ee3f4845a480759a5772055a` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.595031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ccec31ee3f4845a480759a5772055a)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:34.596981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:34.642520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ccec31ee3f4845a480759a5772055a', 'request_id': 'req-5048c4d1-5959-45d5-b399-536ca51ce024'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.651243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ccec31ee3f4845a480759a5772055a', 'request_id': 'req-5048c4d1-5959-45d5-b399-536ca51ce024'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.662835 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ccec31ee3f4845a480759a5772055a', 'request_id': 'req-5048c4d1-5959-45d5-b399-536ca51ce024'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.674741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] The token cache is being invalidate because project 57ccec31ee3f4845a480759a5772055a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:34.675119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.676279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5048c4d1-5959-45d5-b399-536ca51ce024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:34.678194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1226/2427] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:34 2022] DELETE /identity/v3/projects/57ccec31ee3f4845a480759a5772055a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:34.683348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.683746 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.684125 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.703513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:34.704614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:34.762493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1202/2428] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:34.772118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.772479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.772865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.795229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:34.796448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:34.805813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1227/2429] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:34.810050 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:34.819719 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a553-2335-4fbb-b2ab-e8034ae5220c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:34.824713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:34.825359 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.825629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.825896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.826611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:34.826910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:34.828617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:34.839841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1203/2430] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:23:34.843968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:34.853176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1be99-224a-44c8-bf86-c5f68670c483 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:34.858053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:34.858700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.859101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.859473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.860283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:34.862147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:34.890119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1228/2431] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:34 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:34.894453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:34.904379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad19e-d773-4975-bcdb-c866ebc63fdd admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:34.963465 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:34.964056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:34.964328 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:34.964727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:34.965423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:34.967387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:34.986254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1204/2432] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:34 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:34.990646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.002548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca4ab-4d97-4afc-932c-30f04b6bb7ba admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.007187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.007840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.008117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.008385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.009198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.011036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.024655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1229/2433] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:35.026608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.037996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb811c-8a29-4930-b7d7-057e330cfb83 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.042626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d765d-1cf0-4e36-a92a-419d99ff83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.043316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d765d-1cf0-4e36-a92a-419d99ff83ec admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.043594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d765d-1cf0-4e36-a92a-419d99ff83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.043866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d765d-1cf0-4e36-a92a-419d99ff83ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.044583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d765d-1cf0-4e36-a92a-419d99ff83ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.046171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d765d-1cf0-4e36-a92a-419d99ff83ec admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.058263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1205/2434] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:35.063479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.073542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa1ff-d576-450d-86dd-6e6b4692713d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.078355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.079258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.079535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.079802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] PATH_INFO: `/v3/projects/9d2f8c38f7ad4542a67d395c3efe1025/users/c183382b66d548a99222992ac85823f9/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.094124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2f8c38f7ad4542a67d395c3efe1025, user_id=c183382b66d548a99222992ac85823f9, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.096837 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.111818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1230/2435] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:35 2022] PUT /identity/v3/projects/9d2f8c38f7ad4542a67d395c3efe1025/users/c183382b66d548a99222992ac85823f9/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:35.123137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.123424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.123717 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.149774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] MFA Rules not processed for user `c183382b66d548a99222992ac85823f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:35.150965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:35.212883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1206/2436] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:35.217731 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.285537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6e7cc-f6b5-4ed4-a224-4aa851946424 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.293440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.294432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.294722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.295091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.296030 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.299042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.327761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1231/2437] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:35 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:35.331865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.343009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e203-aac5-43af-9482-f32428a33a5f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.399230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.399917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.400171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.400437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.401135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.403076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.425075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1207/2438] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:35 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:35.431076 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.442011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d2df-d026-4bf9-a825-aaf005cc4313 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.447189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.447845 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.448121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.448385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.449119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.450708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.461064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1232/2439] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:35.465143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.475066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ea7e-f6b6-493a-9431-4ce1abfff9c2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.481303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.482480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.483010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.483363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] PATH_INFO: `/v3/projects/f13e80822ccd44ae9beb3d4d6742db7a/users/1f441da902564408bed69151ed1296e6/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.498532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13e80822ccd44ae9beb3d4d6742db7a, user_id=1f441da902564408bed69151ed1296e6, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.501382 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.515772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1208/2440] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:35 2022] PUT /identity/v3/projects/f13e80822ccd44ae9beb3d4d6742db7a/users/1f441da902564408bed69151ed1296e6/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:35.520993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.531252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784be550-8fa1-4e66-8f49-b1151d9d3ff0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.589037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac494df-c009-4f43-968b-fe32167d1306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.589733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac494df-c009-4f43-968b-fe32167d1306 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.590011 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac494df-c009-4f43-968b-fe32167d1306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.590282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac494df-c009-4f43-968b-fe32167d1306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.591039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac494df-c009-4f43-968b-fe32167d1306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.592670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac494df-c009-4f43-968b-fe32167d1306 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.602442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1233/2441] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:35.606872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.617395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a01e-461b-494b-8c84-153ec244271e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.623870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.624753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.625031 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.625327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] PATH_INFO: `/v3/projects/f13e80822ccd44ae9beb3d4d6742db7a/users/1f441da902564408bed69151ed1296e6/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.627542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13e80822ccd44ae9beb3d4d6742db7a, user_id=1f441da902564408bed69151ed1296e6, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.630278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.641430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1209/2442] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:35 2022] PUT /identity/v3/projects/f13e80822ccd44ae9beb3d4d6742db7a/users/1f441da902564408bed69151ed1296e6/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:35.652604 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.653005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.653405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.684428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] MFA Rules not processed for user `1f441da902564408bed69151ed1296e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:35.685660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:35.757389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1234/2443] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:35.768852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:35.770535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:35.829110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7fece-86b0-46d1-8727-1c66fa67e82d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:35.833313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab1321-4204-43a4-9186-568cda31b03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:35.833960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab1321-4204-43a4-9186-568cda31b03a service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:35.834263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab1321-4204-43a4-9186-568cda31b03a service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:35.834556 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab1321-4204-43a4-9186-568cda31b03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:35.844725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab1321-4204-43a4-9186-568cda31b03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:35.846288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab1321-4204-43a4-9186-568cda31b03a service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:35.857213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1210/2444] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:36.271154 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:36.332371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1f89e-7fc3-4f96-9b32-b5a28be9480a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:36.338099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:36.338983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:36.339262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:36.339525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] PATH_INFO: `/v3/users/c183382b66d548a99222992ac85823f9` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:36.340805 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c183382b66d548a99222992ac85823f9)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:36.342738 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:36.390489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c183382b66d548a99222992ac85823f9'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.399461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c183382b66d548a99222992ac85823f9'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.407121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c183382b66d548a99222992ac85823f9'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.407851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c183382b66d548a99222992ac85823f9'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.408548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c183382b66d548a99222992ac85823f9'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.427347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1235/2445] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:36 2022] DELETE /identity/v3/users/c183382b66d548a99222992ac85823f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:36.432080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:36.432571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:36.432694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:36.450865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:36.452089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:36.509732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1211/2446] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:36.523157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:36.525519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:36.589078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7f32-f820-45ee-a6c3-8283843f50a0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:36.593753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:36.594397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:36.594698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:36.595002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:36.604712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:36.606138 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:36.615893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1236/2447] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:36.885275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:36.886801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:36.908931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90bb0b-7017-4b26-b2eb-9239c6b3c206 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:36.914438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:36.915537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:36.915894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:36.916404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] PATH_INFO: `/v3/projects/9d2f8c38f7ad4542a67d395c3efe1025` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:36.917637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2f8c38f7ad4542a67d395c3efe1025)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:36.919689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:36.967891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2f8c38f7ad4542a67d395c3efe1025', 'request_id': 'req-7c8c35b9-852a-48c7-93f9-62cd649dec21'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.973934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2f8c38f7ad4542a67d395c3efe1025', 'request_id': 'req-7c8c35b9-852a-48c7-93f9-62cd649dec21'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.982647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2f8c38f7ad4542a67d395c3efe1025', 'request_id': 'req-7c8c35b9-852a-48c7-93f9-62cd649dec21'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.993356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] The token cache is being invalidate because project 9d2f8c38f7ad4542a67d395c3efe1025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:36.993626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.994273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:36.995842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1212/2448] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:36 2022] DELETE /identity/v3/projects/9d2f8c38f7ad4542a67d395c3efe1025 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:36.999995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.009463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114f9c8-3dc0-4c64-92e5-b98f5cf70dc2 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.071146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.071930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.072199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.072464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] PATH_INFO: `/v3/users/1f441da902564408bed69151ed1296e6` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.073742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f441da902564408bed69151ed1296e6)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.075778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.123390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f441da902564408bed69151ed1296e6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.132111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f441da902564408bed69151ed1296e6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.139102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f441da902564408bed69151ed1296e6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.139784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f441da902564408bed69151ed1296e6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.140466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fb4947a8-56cb-4446-a0a1-0d62396cb639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f441da902564408bed69151ed1296e6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.159364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1237/2449] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:36 2022] DELETE /identity/v3/users/1f441da902564408bed69151ed1296e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:37.443750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.445220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:37.462750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c35b9-852a-48c7-93f9-62cd649dec21 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.518925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.519801 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.520101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.520371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] PATH_INFO: `/v3/projects/f13e80822ccd44ae9beb3d4d6742db7a` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.521590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13e80822ccd44ae9beb3d4d6742db7a)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.523535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.571826 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13e80822ccd44ae9beb3d4d6742db7a', 'request_id': 'req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.578243 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13e80822ccd44ae9beb3d4d6742db7a', 'request_id': 'req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.586191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13e80822ccd44ae9beb3d4d6742db7a', 'request_id': 'req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.597436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] The token cache is being invalidate because project f13e80822ccd44ae9beb3d4d6742db7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:37.597735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.598481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-5d256bf6-b1a8-4959-b12e-6cbdaded64d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:37.600190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1213/2450] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:37 2022] DELETE /identity/v3/projects/f13e80822ccd44ae9beb3d4d6742db7a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:37.605223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.605674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.605768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.622899 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:37.624092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:37.686918 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1238/2451] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:37.697236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81927c5-600e-4431-840f-89446e84832c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.697547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81927c5-600e-4431-840f-89446e84832c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.697824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81927c5-600e-4431-840f-89446e84832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.718782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b81927c5-600e-4431-840f-89446e84832c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:37.721591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b81927c5-600e-4431-840f-89446e84832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:37.731697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1214/2452] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:37.736212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.748420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cf5fe-b273-4de2-877a-35b046b18663 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.756981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.757629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.757900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.758164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.758909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:37.759206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.760838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.773036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1239/2453] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:37.777423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81927c5-600e-4431-840f-89446e84832c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.787220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81927c5-600e-4431-840f-89446e84832c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.793255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.793905 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.794182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.794456 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.795181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.797080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.824469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1215/2454] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:37 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:37.828410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.838774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade200e-b2ce-4028-8a3f-2858bcc57011 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.897372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.898041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.898323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.898596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.899315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.901240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.923395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1240/2455] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:37 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:37.927958 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.938782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2cf64-7b6a-4644-8401-74b3a229ce4d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.945509 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.946188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.946467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.946733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.947499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.949108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.960869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1216/2456] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:37.965160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:37.975584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53609b-c7c2-4267-a77a-01d13fcc4653 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:37.980930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a5913-60f8-43a3-85b5-45035124d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:37.981589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a5913-60f8-43a3-85b5-45035124d273 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:37.981865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a5913-60f8-43a3-85b5-45035124d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:37.982162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a5913-60f8-43a3-85b5-45035124d273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:37.982916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a5913-60f8-43a3-85b5-45035124d273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:37.984529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a5913-60f8-43a3-85b5-45035124d273 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:37.994679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1241/2457] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:37.999082 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.009918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc163bd-a15c-4b86-9cc9-6138c8668c75 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.015086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.015994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.016216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.016487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] PATH_INFO: `/v3/projects/3c28712cd494421fb56150b0a0f9d554/users/9fe89a4fa61540378c61d68e0188337f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.032336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c28712cd494421fb56150b0a0f9d554, user_id=9fe89a4fa61540378c61d68e0188337f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.035099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.049440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1217/2458] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:37 2022] PUT /identity/v3/projects/3c28712cd494421fb56150b0a0f9d554/users/9fe89a4fa61540378c61d68e0188337f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:38.062727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.063136 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.063420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.093069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] MFA Rules not processed for user `9fe89a4fa61540378c61d68e0188337f`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:38.094210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:38.158045 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1242/2459] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:38.165086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.226976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb199-6593-44d7-af8b-a9257ba97ab3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.232066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.232714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.232988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.233251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.233923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.235889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.267098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1218/2460] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:38 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:38.268377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.279445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec03231-be03-46ef-8827-ceefd24921f4 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.344659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.345264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.345545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.345812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.346497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.348507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.373284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1243/2461] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:38 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:38.377852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.388857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145a292-2490-4cb7-9d38-b33815d55b32 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.395179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.395916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.396159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.396422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.397139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.398727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.409858 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1219/2462] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:38.414063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.424579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4192c-d7eb-4e58-a3c5-89fb1a88862e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.430704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f182f2-6cf9-430c-a561-bc285e77de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.431407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f182f2-6cf9-430c-a561-bc285e77de37 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.431692 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f182f2-6cf9-430c-a561-bc285e77de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.431958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f182f2-6cf9-430c-a561-bc285e77de37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.432680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f182f2-6cf9-430c-a561-bc285e77de37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.434273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f182f2-6cf9-430c-a561-bc285e77de37 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.444888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1244/2463] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:38.449001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.459167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522abe14-7e31-44a4-b6e4-cf18ca7f7d11 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.464079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.464945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.465220 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.465490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] PATH_INFO: `/v3/projects/da4cbd98f27f44c9b9d519fa2a5e61e8/users/b334e9cbfc3645c78df6e4fb2e5eb40b/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.480246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4cbd98f27f44c9b9d519fa2a5e61e8, user_id=b334e9cbfc3645c78df6e4fb2e5eb40b, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.482911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.497795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1220/2464] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:38 2022] PUT /identity/v3/projects/da4cbd98f27f44c9b9d519fa2a5e61e8/users/b334e9cbfc3645c78df6e4fb2e5eb40b/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:38.508041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.508334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.508607 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.541889 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] MFA Rules not processed for user `b334e9cbfc3645c78df6e4fb2e5eb40b`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:38.543346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:38.616828 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1245/2465] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:38.621333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.683949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b92658-17fb-408c-9827-72e7766e459e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.688487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.689140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.689455 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.689730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.690414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.692437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.721972 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1221/2466] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:38 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:38.724610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.735739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84423d-6851-4726-a424-b20e2c16aff1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.792871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.793546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.793820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.794195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.794896 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.796836 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.816811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1246/2467] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:38 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:38.820876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.832025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb722fa-bc05-4c09-b151-b10684e3c23b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.836066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.836755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.837030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.837300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.838020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.839644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.853175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1222/2468] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:38.854363 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.864469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f18a9-c207-4b34-9f17-976e0eb29610 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.869232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.870108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.870378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.870687 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] PATH_INFO: `/v3/projects/75e35ecd79924c26b026d8b29a972271/users/915284d0a092497685f17607ff2bc159/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.885622 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e35ecd79924c26b026d8b29a972271, user_id=915284d0a092497685f17607ff2bc159, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.888464 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.904415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1247/2469] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:38 2022] PUT /identity/v3/projects/75e35ecd79924c26b026d8b29a972271/users/915284d0a092497685f17607ff2bc159/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:38.908422 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:38.917996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9cde-2a89-4337-9b0e-dead2458934b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:38.982149 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f71a1-e6e4-4bde-9c2f-3758fd34873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:38.982816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f71a1-e6e4-4bde-9c2f-3758fd34873d admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:38.983123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f71a1-e6e4-4bde-9c2f-3758fd34873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:38.983390 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f71a1-e6e4-4bde-9c2f-3758fd34873d admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:38.984104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f71a1-e6e4-4bde-9c2f-3758fd34873d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:38.985805 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f71a1-e6e4-4bde-9c2f-3758fd34873d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:38.995824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1223/2470] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:38.999930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:39.010393 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4148a-f25d-453b-a3f1-d1e55bfac34e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:39.015016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:39.015904 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:39.016181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:39.016452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] PATH_INFO: `/v3/projects/75e35ecd79924c26b026d8b29a972271/users/915284d0a092497685f17607ff2bc159/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:39.018469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e35ecd79924c26b026d8b29a972271, user_id=915284d0a092497685f17607ff2bc159, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:39.021319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:39.031785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1248/2471] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:38 2022] PUT /identity/v3/projects/75e35ecd79924c26b026d8b29a972271/users/915284d0a092497685f17607ff2bc159/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:39.042338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:39.042693 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:39.043067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:39.070586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] MFA Rules not processed for user `915284d0a092497685f17607ff2bc159`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:39.071818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:39.137882 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1224/2472] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:39.149695 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:39.151993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:39.212156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dec288-f94c-4eb0-8685-329763630add admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:39.216077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:39.216712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:39.216992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:39.217265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:39.226147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:39.227609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:39.236752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1249/2473] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:39.278300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:39.279791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:39.291987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f159d-7c2c-424d-94a5-b61fb82b6e9d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:39.295962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b1329-0349-46f5-81d1-74fb21366075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:39.296605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1329-0349-46f5-81d1-74fb21366075 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:39.296885 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1329-0349-46f5-81d1-74fb21366075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:39.297155 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b1329-0349-46f5-81d1-74fb21366075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:39.355383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b1329-0349-46f5-81d1-74fb21366075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:39.356815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b1329-0349-46f5-81d1-74fb21366075 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:39.365947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1225/2474] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:46.493103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:46.557199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fe1b2-5456-48ae-b4de-3fb4f15327ed service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:46.562771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:46.563675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:46.563950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:46.564215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] PATH_INFO: `/v3/users/9fe89a4fa61540378c61d68e0188337f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:46.565547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe89a4fa61540378c61d68e0188337f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:46.567833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:46.619244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe89a4fa61540378c61d68e0188337f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:46.629991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe89a4fa61540378c61d68e0188337f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:46.639055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe89a4fa61540378c61d68e0188337f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:46.639802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe89a4fa61540378c61d68e0188337f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:46.640615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe89a4fa61540378c61d68e0188337f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:46.659924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1250/2475] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:46 2022] DELETE /identity/v3/users/9fe89a4fa61540378c61d68e0188337f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:46.664841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113542-9b65-4417-ae98-53debd279042 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:46.665512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113542-9b65-4417-ae98-53debd279042 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:46.665512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be113542-9b65-4417-ae98-53debd279042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:46.683007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-be113542-9b65-4417-ae98-53debd279042 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:46.684263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-be113542-9b65-4417-ae98-53debd279042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:46.744285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1226/2476] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:46.755675 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:46.757254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:46.818514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adaf42-66cf-4323-9f8c-e83a44cd8768 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:46.825409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bbc53-6d25-405d-9990-6a76b46645ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:46.826064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbc53-6d25-405d-9990-6a76b46645ec service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:46.826303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbc53-6d25-405d-9990-6a76b46645ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:46.826599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bbc53-6d25-405d-9990-6a76b46645ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:46.836309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bbc53-6d25-405d-9990-6a76b46645ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:46.837742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bbc53-6d25-405d-9990-6a76b46645ec service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:46.847181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1251/2477] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:46.909453 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113542-9b65-4417-ae98-53debd279042 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:46.911320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-be113542-9b65-4417-ae98-53debd279042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:46.925633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be113542-9b65-4417-ae98-53debd279042 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:46.930429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:46.931340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:46.931628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:46.931910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] PATH_INFO: `/v3/users/817307c704b94208be9ebf6d3a043c1f` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:46.933139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817307c704b94208be9ebf6d3a043c1f)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:46.935086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:46.984436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817307c704b94208be9ebf6d3a043c1f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:46.993117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817307c704b94208be9ebf6d3a043c1f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.000341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817307c704b94208be9ebf6d3a043c1f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.001108 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817307c704b94208be9ebf6d3a043c1f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.013860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817307c704b94208be9ebf6d3a043c1f'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.020931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1227/2478] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:46 2022] DELETE /identity/v3/users/817307c704b94208be9ebf6d3a043c1f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:47.025504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.025796 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.026072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.043725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:47.044923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.105459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1252/2479] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:47.113395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.114992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.116342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.120012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.129702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bcadd-08e2-40b8-9a99-15d0bc752218 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.135540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.136396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.136675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.136946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] PATH_INFO: `/v3/projects/3c28712cd494421fb56150b0a0f9d554` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.138148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c28712cd494421fb56150b0a0f9d554)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.140133 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.179476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948f22d-35a9-49db-ad76-1aa1d124c75a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.189055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c28712cd494421fb56150b0a0f9d554', 'request_id': 'req-4c2a142d-1e7d-4b11-aeff-e833eca11b50'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.195096 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c28712cd494421fb56150b0a0f9d554', 'request_id': 'req-4c2a142d-1e7d-4b11-aeff-e833eca11b50'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.203298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c28712cd494421fb56150b0a0f9d554', 'request_id': 'req-4c2a142d-1e7d-4b11-aeff-e833eca11b50'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.213188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] The token cache is being invalidate because project 3c28712cd494421fb56150b0a0f9d554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:47.213469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.214103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.215939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1228/2480] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:47 2022] DELETE /identity/v3/projects/3c28712cd494421fb56150b0a0f9d554 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:47.219512 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.220830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.227982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.228633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.228912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.229185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.231001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.281938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a142d-1e7d-4b11-aeff-e833eca11b50 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.287227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.288087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.288514 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.288782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] PATH_INFO: `/v3/users/b334e9cbfc3645c78df6e4fb2e5eb40b` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.289955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b334e9cbfc3645c78df6e4fb2e5eb40b)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.291614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.291893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.293062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.302650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1253/2481] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:23:47.338654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b334e9cbfc3645c78df6e4fb2e5eb40b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.346150 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b334e9cbfc3645c78df6e4fb2e5eb40b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.353429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b334e9cbfc3645c78df6e4fb2e5eb40b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.354357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b334e9cbfc3645c78df6e4fb2e5eb40b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.367316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b334e9cbfc3645c78df6e4fb2e5eb40b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.373617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1229/2482] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:47 2022] DELETE /identity/v3/users/b334e9cbfc3645c78df6e4fb2e5eb40b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:47.627890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.630162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.643194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a13bd5-008c-41b7-b8a3-c3e83c10fefb service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.700872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.701754 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.702069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.702531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] PATH_INFO: `/v3/projects/0005e6247b2745149e94379cc3148195` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.703762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0005e6247b2745149e94379cc3148195)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.705841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.724501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.726622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.745391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01affb-9db2-4978-a4d0-f8b946fa7ecf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.758013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0005e6247b2745149e94379cc3148195', 'request_id': 'req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.766638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0005e6247b2745149e94379cc3148195', 'request_id': 'req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.773551 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0005e6247b2745149e94379cc3148195', 'request_id': 'req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.784934 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] The token cache is being invalidate because project 0005e6247b2745149e94379cc3148195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:47.785235 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.786092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.788021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1254/2483] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:47 2022] DELETE /identity/v3/projects/0005e6247b2745149e94379cc3148195 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:47.792022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.793696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.807380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.808249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.808524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.808794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] PATH_INFO: `/v3/projects/da4cbd98f27f44c9b9d519fa2a5e61e8` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.809959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4cbd98f27f44c9b9d519fa2a5e61e8)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.811898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.857666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff9351-fbcc-40d7-a5f7-3b3c3092c0c8 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.858054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4cbd98f27f44c9b9d519fa2a5e61e8', 'request_id': 'req-f78b83ad-8102-4659-ac6d-0599abe68a9b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.864373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4cbd98f27f44c9b9d519fa2a5e61e8', 'request_id': 'req-f78b83ad-8102-4659-ac6d-0599abe68a9b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.872685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4cbd98f27f44c9b9d519fa2a5e61e8', 'request_id': 'req-f78b83ad-8102-4659-ac6d-0599abe68a9b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.883366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] The token cache is being invalidate because project da4cbd98f27f44c9b9d519fa2a5e61e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:47.883657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.884277 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.885928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1230/2484] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:47 2022] DELETE /identity/v3/projects/da4cbd98f27f44c9b9d519fa2a5e61e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:47.890109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:47.891648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:47.912563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.913368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.913642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.913914 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] PATH_INFO: `/v3/users/5d5c4b4a9d644501b72d1ea550ef940d` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.915135 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5c4b4a9d644501b72d1ea550ef940d)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.917056 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.954528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b83ad-8102-4659-ac6d-0599abe68a9b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:47.959213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:47.960079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:47.960358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:47.960623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] PATH_INFO: `/v3/users/915284d0a092497685f17607ff2bc159` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:47.961794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915284d0a092497685f17607ff2bc159)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:47.963501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5c4b4a9d644501b72d1ea550ef940d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.963739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:47.971314 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5c4b4a9d644501b72d1ea550ef940d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.978817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5c4b4a9d644501b72d1ea550ef940d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.979649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5c4b4a9d644501b72d1ea550ef940d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.980268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5c4b4a9d644501b72d1ea550ef940d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:47.998462 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1255/2485] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:47 2022] DELETE /identity/v3/users/5d5c4b4a9d644501b72d1ea550ef940d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:48.009797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915284d0a092497685f17607ff2bc159'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.016856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915284d0a092497685f17607ff2bc159'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.024418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915284d0a092497685f17607ff2bc159'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.025192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915284d0a092497685f17607ff2bc159'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.038203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915284d0a092497685f17607ff2bc159'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.044238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1231/2486] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:47 2022] DELETE /identity/v3/users/915284d0a092497685f17607ff2bc159 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:48.317426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.319064 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:48.377833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.379642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:48.390171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e11d-cc9d-4be3-998c-ce125153bd08 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.447865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.448645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.448924 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.449193 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] PATH_INFO: `/v3/projects/49a67b36ec494e0d8b8769d513053875` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.450294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dfc62-e154-4334-9f1b-4f0c9b35f345 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.450418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a67b36ec494e0d8b8769d513053875)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.452346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.454845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.455727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.456002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.456271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] PATH_INFO: `/v3/projects/75e35ecd79924c26b026d8b29a972271` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.457467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e35ecd79924c26b026d8b29a972271)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.459425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.498007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a67b36ec494e0d8b8769d513053875', 'request_id': 'req-af231f2d-a910-4120-9a9a-dc0ad35f73aa'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.505824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e35ecd79924c26b026d8b29a972271', 'request_id': 'req-50bb10f5-25f4-4a53-9d03-920eb5b6d167'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.507161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a67b36ec494e0d8b8769d513053875', 'request_id': 'req-af231f2d-a910-4120-9a9a-dc0ad35f73aa'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.512321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e35ecd79924c26b026d8b29a972271', 'request_id': 'req-50bb10f5-25f4-4a53-9d03-920eb5b6d167'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.513364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a67b36ec494e0d8b8769d513053875', 'request_id': 'req-af231f2d-a910-4120-9a9a-dc0ad35f73aa'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.520092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e35ecd79924c26b026d8b29a972271', 'request_id': 'req-50bb10f5-25f4-4a53-9d03-920eb5b6d167'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.523879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] The token cache is being invalidate because project 49a67b36ec494e0d8b8769d513053875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:48.524165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.524784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af231f2d-a910-4120-9a9a-dc0ad35f73aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.526624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1256/2487] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:48 2022] DELETE /identity/v3/projects/49a67b36ec494e0d8b8769d513053875 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:48.531234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5078-e1f4-44fa-a60b-a143885d749b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.531451 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] The token cache is being invalidate because project 75e35ecd79924c26b026d8b29a972271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:48.531560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5078-e1f4-44fa-a60b-a143885d749b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.531740 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.531901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b5078-e1f4-44fa-a60b-a143885d749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.532372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-50bb10f5-25f4-4a53-9d03-920eb5b6d167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:48.534057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1232/2488] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:48 2022] DELETE /identity/v3/projects/75e35ecd79924c26b026d8b29a972271 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:48.539471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c391-b9cc-4ce7-b38d-0090715d02eb None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.539831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c391-b9cc-4ce7-b38d-0090715d02eb None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.540174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c391-b9cc-4ce7-b38d-0090715d02eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.550605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-cd5b5078-e1f4-44fa-a60b-a143885d749b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:48.551983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cd5b5078-e1f4-44fa-a60b-a143885d749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:48.558203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2c35c391-b9cc-4ce7-b38d-0090715d02eb None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:48.559393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2c35c391-b9cc-4ce7-b38d-0090715d02eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:48.612992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1257/2489] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:48.620834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.621118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.621387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.622758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1233/2490] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:48.631089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.631373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.631647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.640499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:48.641797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:48.650479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1258/2491] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:48.653444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:48.654617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.655130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:48.665763 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369ca3-c4d1-4f19-a29e-03bb93f95a3f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.666928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1234/2492] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:48.669960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.671483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.672040 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.672316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.672577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.673297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:48.673594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.675521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.680026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972ac67-ab0d-403c-9e7d-2405d059f944 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.684933 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.685584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.685861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.686134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.686857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:48.687190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.690933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1259/2493] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:48.691332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.692280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.701004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1235/2494] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:23:48.704105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883bdeb-5e3b-4ae7-8e3f-f98ce28e0b18 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.705557 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.708809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.709449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.709725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.709993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.710663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.712595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.715175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a7cf0-76e3-460d-a76a-9c17e9725cc8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.719631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.720261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.720536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.720803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.721474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.723547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.738784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1260/2495] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:48.742982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.748829 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1236/2496] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:48.752718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.803671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65abf09-291e-45df-a31d-398f204f073e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.815337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29e81f-777a-4212-b09f-af89bf58bf3c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.820071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.820741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.821018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.821306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.822010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.824001 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.846279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1237/2497] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:48.850560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.859736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.860054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31162-72b8-40b1-a83a-107bee63277f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.860412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.860779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.860973 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.861719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.863902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.865373 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.866041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.866315 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.866582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.867402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.869134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.880317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1238/2498] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:48.885806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1261/2499] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:48.885968 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.886891 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.893656 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b91c-1675-469a-b77d-edfe6bca591d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.896819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fd10d-a122-47d8-b5ef-6acdd7195fc6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.898358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.899152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.899487 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.899702 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.900449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.901344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.902007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.902110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.902281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.902543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.903353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.904971 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.913284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1239/2500] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:48.915472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1262/2501] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:48.917998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.919831 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.929645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9da301-84e7-4cf3-8189-4be7c37fc94b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.930226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272809b-3452-43c1-bb6f-826d677136ae admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.934126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.934810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.934937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004feb5-d6a2-4de6-b798-585f301be74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:48.935169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.935453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.935794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004feb5-d6a2-4de6-b798-585f301be74f admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.936076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004feb5-d6a2-4de6-b798-585f301be74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.936185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.936345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004feb5-d6a2-4de6-b798-585f301be74f admin admin] PATH_INFO: `/v3/projects/31918ae919824f5cb1a1d50b570f22ad/users/ab980ff2aee74392b63a2909f31a800d/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:48.937720 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.951179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1263/2502] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:48.951339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004feb5-d6a2-4de6-b798-585f301be74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31918ae919824f5cb1a1d50b570f22ad, user_id=ab980ff2aee74392b63a2909f31a800d, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:48.952059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:48.953571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004feb5-d6a2-4de6-b798-585f301be74f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:48.961261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c9bd-f4bd-433b-9aa8-aecb1d2cb5ec admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:48.967230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1240/2503] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:48 2022] PUT /identity/v3/projects/31918ae919824f5cb1a1d50b570f22ad/users/ab980ff2aee74392b63a2909f31a800d/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:48.978507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:48.978791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:48.979092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.004857 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] MFA Rules not processed for user `ab980ff2aee74392b63a2909f31a800d`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:49.006055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.018273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401d27-e2c3-4929-a37e-8a2b65ff43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.019229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401d27-e2c3-4929-a37e-8a2b65ff43c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.019505 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401d27-e2c3-4929-a37e-8a2b65ff43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.019797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401d27-e2c3-4929-a37e-8a2b65ff43c7 admin admin] PATH_INFO: `/v3/projects/593a9465f75c49ddb8914177e0ce300e/users/df2a4621147e4d038fe4f2b138dd088d/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.035102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34401d27-e2c3-4929-a37e-8a2b65ff43c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593a9465f75c49ddb8914177e0ce300e, user_id=df2a4621147e4d038fe4f2b138dd088d, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.037922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34401d27-e2c3-4929-a37e-8a2b65ff43c7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.052872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1264/2504] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:48 2022] PUT /identity/v3/projects/593a9465f75c49ddb8914177e0ce300e/users/df2a4621147e4d038fe4f2b138dd088d/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:49.064387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.064733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.065004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.075367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1241/2505] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:49.087290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.088861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.093343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] MFA Rules not processed for user `df2a4621147e4d038fe4f2b138dd088d`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:49.094550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.144691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fbe9d-0254-4f31-add7-d06050b63d2a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.156213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1265/2506] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:49.160670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.195420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.196139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.196469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.196772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.221613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e806a3-a0bc-4d55-8f71-83335b1f2e3c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.226204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.226854 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.227150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.227417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.228088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.230007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.250852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.252299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.258276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1266/2507] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:49 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:49.259354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.261715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1242/2508] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:49.281763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.293017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb881b-436c-40b7-ba88-8e1d9bc3d9a2 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.321250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167d8b5-8279-4573-816a-8cce7f534474 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.325697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.326371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.326641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.326917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.327594 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.329509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.348124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.348996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.349258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1267/2509] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:49 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:49.349398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.349515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] PATH_INFO: `/v3/users/ab980ff2aee74392b63a2909f31a800d` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.350725 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab980ff2aee74392b63a2909f31a800d)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.352683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.353088 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.362602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511050d-b35c-4232-8de9-ba7514276911 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.367396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.368036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.368316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.368637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.369309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.370922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.381313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1268/2510] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:49.385549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.395477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd4e06-1a0c-42ae-b984-b7eef447f65b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.400380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.400893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab980ff2aee74392b63a2909f31a800d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:49.401231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.401509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.401779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] PATH_INFO: `/v3/projects/f37614ad15f24b7f9afa0c39ddd66191/users/db29f18981ce4fd992c93dc06f1bb8ef/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.409146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab980ff2aee74392b63a2909f31a800d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:49.416066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab980ff2aee74392b63a2909f31a800d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:49.416683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab980ff2aee74392b63a2909f31a800d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:49.417531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37614ad15f24b7f9afa0c39ddd66191, user_id=db29f18981ce4fd992c93dc06f1bb8ef, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.420265 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.428539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2037c2b5-ecc8-444b-b138-4c1123b0c67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab980ff2aee74392b63a2909f31a800d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:49.433491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1269/2511] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:49 2022] PUT /identity/v3/projects/f37614ad15f24b7f9afa0c39ddd66191/users/db29f18981ce4fd992c93dc06f1bb8ef/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:49.434608 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1243/2512] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:49 2022] DELETE /identity/v3/users/ab980ff2aee74392b63a2909f31a800d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:49.437450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.438976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.439098 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.439391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.439724 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.458341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:49.459537 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.501506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbf1ba-b1c9-4682-be38-523f1f249843 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.516511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1244/2513] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:49.526215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.527538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.555577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.556239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.556530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.556778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.557497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.559096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.568690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1270/2514] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:49.572698 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.581783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f2e30-76a5-4fb9-8ed2-abe05656f989 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.582821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66045c4e-48b8-4fb3-99d3-ec963f347a56 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.586303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ace0a3-77df-4a76-b729-17cd4bed8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.586440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.587134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.587248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ace0a3-77df-4a76-b729-17cd4bed8859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.587411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.587511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ace0a3-77df-4a76-b729-17cd4bed8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.587679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ace0a3-77df-4a76-b729-17cd4bed8859 admin admin] PATH_INFO: `/v3/projects/f37614ad15f24b7f9afa0c39ddd66191/users/db29f18981ce4fd992c93dc06f1bb8ef/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.587777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.589572 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ace0a3-77df-4a76-b729-17cd4bed8859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37614ad15f24b7f9afa0c39ddd66191, user_id=db29f18981ce4fd992c93dc06f1bb8ef, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.592204 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ace0a3-77df-4a76-b729-17cd4bed8859 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.596593 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.598015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.601865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1271/2515] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:49 2022] PUT /identity/v3/projects/f37614ad15f24b7f9afa0c39ddd66191/users/db29f18981ce4fd992c93dc06f1bb8ef/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:49.607291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1245/2516] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:23:49.611656 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.611939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.612210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.641419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] MFA Rules not processed for user `db29f18981ce4fd992c93dc06f1bb8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:49.642602 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.720895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1272/2517] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:49.728791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.731074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.796157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4883c5-5483-4b5d-a394-665dd7044dff service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.854356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.855052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.855337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.855610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.865166 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.866619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:49.879060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1246/2518] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:49 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:49.896099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.899390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.947503 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:49.958304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98722-8c13-4e4e-8b58-23592ff5a130 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.962922 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.963573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.963844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.964110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.965928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:49.982909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690056c-1ccf-4ea4-8cee-62348506ab95 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:49.988256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:49.989423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:49.989699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:49.990321 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] PATH_INFO: `/v3/projects/31918ae919824f5cb1a1d50b570f22ad` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:49.991839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] RBAC: Authorizing `identity:delete_project(project_id=31918ae919824f5cb1a1d50b570f22ad)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:49.994059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.034930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.036420 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a5cea-7850-4acf-9062-9d0fc87b46f2 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.041522 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31918ae919824f5cb1a1d50b570f22ad', 'request_id': 'req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.045131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1247/2519] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:23:50.049432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31918ae919824f5cb1a1d50b570f22ad', 'request_id': 'req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.056240 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31918ae919824f5cb1a1d50b570f22ad', 'request_id': 'req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.066208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] The token cache is being invalidate because project 31918ae919824f5cb1a1d50b570f22ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:50.066519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.067197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f6c69d73-ce0b-436f-8a4e-b3ec66dc04db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.068739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1273/2520] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:49 2022] DELETE /identity/v3/projects/31918ae919824f5cb1a1d50b570f22ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:50.073957 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.074246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.074520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.093419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:50.094647 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:50.152909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1248/2521] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:50.161660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.162018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.162451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.183183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:50.184793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:50.194614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1274/2522] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:50.198811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.209478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30d444-1cab-4524-a9cc-ab1892d05060 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.214506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.215207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.215488 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.215763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.216511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:50.216822 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.218419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.229995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1249/2523] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:50.234898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.246048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641fa5d-04e2-4401-b604-5a262560abc2 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.251172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.251824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.252105 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.252379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.253071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.256465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.292832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1275/2524] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:50 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:50.294517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.305753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270306-a162-4153-b423-7e5bf8d67038 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.364665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.365365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.365632 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.365900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.366619 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.368854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.392135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1250/2525] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:50 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:50.393345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.403702 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255eb88c-12dd-4cca-a5bc-23750b02ae52 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.409167 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.410008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.410364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.410814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.411679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.413298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.425412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1276/2526] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:50.429615 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.439729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147f5a6-0f7e-45e0-b9f3-34fff7fed645 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.444738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e16a8-1b58-4b3e-a59d-b45fc141ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.445389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e16a8-1b58-4b3e-a59d-b45fc141ea50 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.445683 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e16a8-1b58-4b3e-a59d-b45fc141ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.445938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e16a8-1b58-4b3e-a59d-b45fc141ea50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.446660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e16a8-1b58-4b3e-a59d-b45fc141ea50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.448286 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e16a8-1b58-4b3e-a59d-b45fc141ea50 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.458252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1251/2527] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:50.462409 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.472822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec751-3592-41bc-aa69-1128725b1bf3 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.478132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.479033 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.479309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.479575 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] PATH_INFO: `/v3/projects/aedf4fcc9daf47ffa0b33ebe9963db38/users/ddb2d04f3461487284126c0b63db2df9/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.494339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedf4fcc9daf47ffa0b33ebe9963db38, user_id=ddb2d04f3461487284126c0b63db2df9, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.497062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.512323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1277/2528] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:50 2022] PUT /identity/v3/projects/aedf4fcc9daf47ffa0b33ebe9963db38/users/ddb2d04f3461487284126c0b63db2df9/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:50.523053 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.523278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.523676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.552340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] MFA Rules not processed for user `ddb2d04f3461487284126c0b63db2df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:50.553530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:50.620499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1252/2529] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:50.634457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.636371 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:50.696694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb984be-3290-4c80-9588-22733427a362 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.700706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689e01f-ff46-44b4-9f98-d9cd22920918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.701357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e01f-ff46-44b4-9f98-d9cd22920918 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.701659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e01f-ff46-44b4-9f98-d9cd22920918 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.701932 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689e01f-ff46-44b4-9f98-d9cd22920918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.710330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e01f-ff46-44b4-9f98-d9cd22920918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.711815 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689e01f-ff46-44b4-9f98-d9cd22920918 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.720736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1278/2530] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:50.740147 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:50.803998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843dc0d-f98b-42b7-a617-cfccff083392 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:50.809866 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:50.810778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.811100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.811369 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] PATH_INFO: `/v3/users/ddb2d04f3461487284126c0b63db2df9` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.812795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb2d04f3461487284126c0b63db2df9)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:50.814730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:50.868528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb2d04f3461487284126c0b63db2df9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.878665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb2d04f3461487284126c0b63db2df9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.887644 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb2d04f3461487284126c0b63db2df9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.888412 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb2d04f3461487284126c0b63db2df9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.902562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb2d04f3461487284126c0b63db2df9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:50.908633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1253/2531] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:50 2022] DELETE /identity/v3/users/ddb2d04f3461487284126c0b63db2df9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:50.914856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:50.915649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:50.915941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:50.936390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:50.937611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:51.001009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1279/2532] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:51.013057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.014618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:51.074980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc76de-701c-4ccf-9586-e45766cc446a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.078751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdf8c7-967c-4d2a-97bc-a01876f0d0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.079418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdf8c7-967c-4d2a-97bc-a01876f0d0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.079714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdf8c7-967c-4d2a-97bc-a01876f0d0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.079975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdf8c7-967c-4d2a-97bc-a01876f0d0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.089232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdf8c7-967c-4d2a-97bc-a01876f0d0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.090652 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdf8c7-967c-4d2a-97bc-a01876f0d0a6 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.100104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1254/2533] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:51.421838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.423638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:51.439615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f55b-f0e4-4a94-9c86-a985d7cda110 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.442747 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.443733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.444013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.444279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] PATH_INFO: `/v3/projects/aedf4fcc9daf47ffa0b33ebe9963db38` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.445467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aedf4fcc9daf47ffa0b33ebe9963db38)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.447468 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.495327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aedf4fcc9daf47ffa0b33ebe9963db38', 'request_id': 'req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:51.503192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aedf4fcc9daf47ffa0b33ebe9963db38', 'request_id': 'req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:51.509496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aedf4fcc9daf47ffa0b33ebe9963db38', 'request_id': 'req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:51.519509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] The token cache is being invalidate because project aedf4fcc9daf47ffa0b33ebe9963db38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:51.519819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:51.520457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-3323feb9-69eb-4b6b-9c7d-c0e2782b7a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:51.522213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1280/2534] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:51 2022] DELETE /identity/v3/projects/aedf4fcc9daf47ffa0b33ebe9963db38 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:51.527337 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.527663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.527967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.545995 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:51.547352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:51.607304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1255/2535] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:23:51.615435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.615722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.615998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.635728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:51.636907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:51.645234 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1281/2536] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:51.651092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.661225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d3874-b89a-4d0e-9382-ce7dfe53d234 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.668541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.669203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.669507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.669776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.670519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:51.670814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.672452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.686320 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1256/2537] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:51.691001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.700862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e72e0b-4bfa-4c8c-96f8-ad2e283230d1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.706795 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.707530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.707810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.708082 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.708784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.711469 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.745619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1282/2538] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:51 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:51.749827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.760360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743545-b2b7-43c4-ac0e-fb96d0ca5416 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.821068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.821747 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.822025 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.822298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.823042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.824998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.845206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1257/2539] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:51 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:51.849446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.861922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed437c78-29f6-4bd4-b230-b8afeae998ad admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.869630 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.870739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.871268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.871760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.873020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.875663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.890972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1283/2540] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:51.896004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.911305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6313e8-6240-4116-a9c5-b8896165a962 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.917250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5425-c34e-4d84-852b-69afd45494d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.917852 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5425-c34e-4d84-852b-69afd45494d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.918146 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5425-c34e-4d84-852b-69afd45494d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.918395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5425-c34e-4d84-852b-69afd45494d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.919139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f5425-c34e-4d84-852b-69afd45494d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.920795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f5425-c34e-4d84-852b-69afd45494d3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.931486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1258/2541] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:51.936186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:51.948266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa7c4b-a28d-4754-8bf8-2219dbdbb86e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:51.954191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:51.955097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:51.955372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:51.955641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] PATH_INFO: `/v3/projects/c1067ec3f1b641cc8ef8d5ab8b370389/users/c78052b2f37546d39483cec0504bfa8d/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:51.971068 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1067ec3f1b641cc8ef8d5ab8b370389, user_id=c78052b2f37546d39483cec0504bfa8d, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:51.973855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:51.993529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1284/2542] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:51 2022] PUT /identity/v3/projects/c1067ec3f1b641cc8ef8d5ab8b370389/users/c78052b2f37546d39483cec0504bfa8d/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:52.010178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:52.010541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:52.011010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:52.047504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] MFA Rules not processed for user `c78052b2f37546d39483cec0504bfa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:52.048706 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:52.117689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1259/2543] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:52.131028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:52.132943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:52.197272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2ceec-3982-48bb-9206-1bcfc38e45e1 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:52.201339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032c8e-0cbf-4991-9688-c4d668ed0c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:52.201977 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032c8e-0cbf-4991-9688-c4d668ed0c64 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:52.202253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032c8e-0cbf-4991-9688-c4d668ed0c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:52.202527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032c8e-0cbf-4991-9688-c4d668ed0c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:52.211155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86032c8e-0cbf-4991-9688-c4d668ed0c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:52.212624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86032c8e-0cbf-4991-9688-c4d668ed0c64 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:52.221432 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1285/2544] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:53.509934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:53.511507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:53.597599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c8488-2dc6-491e-a4dd-d2e3bfc7e176 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:53.603654 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:53.604591 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:53.605015 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:53.605426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] PATH_INFO: `/v3/users/df2a4621147e4d038fe4f2b138dd088d` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:53.606641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2a4621147e4d038fe4f2b138dd088d)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:53.608662 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:53.671803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2a4621147e4d038fe4f2b138dd088d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:53.680172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2a4621147e4d038fe4f2b138dd088d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:53.689467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2a4621147e4d038fe4f2b138dd088d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:53.690723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2a4621147e4d038fe4f2b138dd088d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:53.710763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2a4621147e4d038fe4f2b138dd088d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:53.718865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1260/2545] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:53 2022] DELETE /identity/v3/users/df2a4621147e4d038fe4f2b138dd088d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:53.723214 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:53.724219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:53.724497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:53.742574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:53.743784 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:53.816165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1286/2546] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:53.825861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:53.827371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:53.885076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024009af-8df5-4111-bccb-c939cf5ae59d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:53.888891 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:53.889490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:53.889765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:53.890060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:53.899633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:53.900973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:53.910450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1261/2547] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:54.189428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:54.192289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:54.203175 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2fe31-0446-496f-9c79-3cce2c0364aa None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:54.208323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:54.209447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:54.209793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:54.210126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] PATH_INFO: `/v3/projects/593a9465f75c49ddb8914177e0ce300e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:54.211503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=593a9465f75c49ddb8914177e0ce300e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:54.213530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:54.260362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593a9465f75c49ddb8914177e0ce300e', 'request_id': 'req-fd09e383-7375-45a6-afd1-85c18fde0a6a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.270122 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593a9465f75c49ddb8914177e0ce300e', 'request_id': 'req-fd09e383-7375-45a6-afd1-85c18fde0a6a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.276306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593a9465f75c49ddb8914177e0ce300e', 'request_id': 'req-fd09e383-7375-45a6-afd1-85c18fde0a6a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.287473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] The token cache is being invalidate because project 593a9465f75c49ddb8914177e0ce300e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:54.287756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.288378 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.290107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1287/2548] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:54 2022] DELETE /identity/v3/projects/593a9465f75c49ddb8914177e0ce300e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:54.294438 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:54.304345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bb095-68a7-4127-8643-e2ce8ae49c19 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:54.360199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:54.361062 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:54.361340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:54.361611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] PATH_INFO: `/v3/users/db29f18981ce4fd992c93dc06f1bb8ef` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:54.362824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db29f18981ce4fd992c93dc06f1bb8ef)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:54.364790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:54.413561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db29f18981ce4fd992c93dc06f1bb8ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.422424 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db29f18981ce4fd992c93dc06f1bb8ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.429620 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db29f18981ce4fd992c93dc06f1bb8ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.430239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db29f18981ce4fd992c93dc06f1bb8ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.441763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2e5e57e3-4191-44bf-bc3a-d7a31d256535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db29f18981ce4fd992c93dc06f1bb8ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.447778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1262/2549] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:54 2022] DELETE /identity/v3/users/db29f18981ce4fd992c93dc06f1bb8ef => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:54.746766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:54.748336 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:54.761328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09e383-7375-45a6-afd1-85c18fde0a6a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:54.825797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:54.826661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:54.826964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:54.827253 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] PATH_INFO: `/v3/projects/f37614ad15f24b7f9afa0c39ddd66191` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:54.828442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37614ad15f24b7f9afa0c39ddd66191)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:54.830305 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:54.879410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37614ad15f24b7f9afa0c39ddd66191', 'request_id': 'req-31af95a7-d375-407c-9dd9-77c1fdc3af9b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.888223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37614ad15f24b7f9afa0c39ddd66191', 'request_id': 'req-31af95a7-d375-407c-9dd9-77c1fdc3af9b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.894420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37614ad15f24b7f9afa0c39ddd66191', 'request_id': 'req-31af95a7-d375-407c-9dd9-77c1fdc3af9b'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.904481 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] The token cache is being invalidate because project f37614ad15f24b7f9afa0c39ddd66191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:54.904762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.905386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-31af95a7-d375-407c-9dd9-77c1fdc3af9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:54.906951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1288/2550] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:54 2022] DELETE /identity/v3/projects/f37614ad15f24b7f9afa0c39ddd66191 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:54.912048 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:54.912528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:54.912672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:54.931199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:54.932375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:54.992012 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1263/2551] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:55.003419 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.003678 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.003965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.022271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:55.023662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:55.032220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1289/2552] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:55.036694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.046977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51eeb-785a-46c1-bcea-d1dead101cd3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.052492 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.053131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.053409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.053678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.054389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:55.054691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.056442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.068219 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1264/2553] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:55.072491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.083293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6310ef8-5510-4cd1-a464-56d554d8b2a0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.089476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.090119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.090394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.090662 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.091418 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.093353 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.120361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1290/2554] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:55.124831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.135301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a192d3c-abe9-4392-ae31-7864110fc94d admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.197261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.197913 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.198187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.198454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.199158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.201056 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.223173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1265/2555] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:55.227352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.238239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5203-d665-451a-9602-1bf174595911 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.243777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.244434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.244703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.244974 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.245693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.247340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.258183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1291/2556] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:23:55.262043 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.272517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89c839-1677-4c5a-8d8f-887083099be6 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.278269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44015bf-ea6b-40c4-a141-0970dd62c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.278976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44015bf-ea6b-40c4-a141-0970dd62c967 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.279255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44015bf-ea6b-40c4-a141-0970dd62c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.279520 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44015bf-ea6b-40c4-a141-0970dd62c967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.280264 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44015bf-ea6b-40c4-a141-0970dd62c967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.281834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44015bf-ea6b-40c4-a141-0970dd62c967 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.292212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1266/2557] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:55.296480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.307523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0a942-5105-48a2-b30b-63d562e6c6ef admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.313307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.314230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.314529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.314819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] PATH_INFO: `/v3/projects/80c56f6316db4879a3f954d6744787dc/users/91e16658279f4a6fa0822c1f533afa44/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.329902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c56f6316db4879a3f954d6744787dc, user_id=91e16658279f4a6fa0822c1f533afa44, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.332807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.348323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1292/2558] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:55 2022] PUT /identity/v3/projects/80c56f6316db4879a3f954d6744787dc/users/91e16658279f4a6fa0822c1f533afa44/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:55.360375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.360710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.361083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.388485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] MFA Rules not processed for user `91e16658279f4a6fa0822c1f533afa44`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:55.389595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:55.464674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1267/2559] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:55.469777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.538058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41420c-9a12-4951-9bf7-e3d760384c33 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.544142 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.544793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.545066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.545329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.546000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.547946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.575876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1293/2560] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:55.582197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.593101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6bd8-8b5b-4af9-8679-413cb0acfdbe None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.650075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.650635 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.650928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.651209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.651876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.653779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.681672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1268/2561] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:55.682937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.696521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb01b3-d7fe-4e15-b34f-79ea21a8540a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.703067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.703744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.704074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.704364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.705092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.706690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.718284 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1294/2562] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:55.722674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.732561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af493e8c-58f1-4e85-b228-53d49718af9a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.737409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.738287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.738628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.738920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] PATH_INFO: `/v3/projects/d97401f5a19b4170b00e9f6300b0ea22/users/bc7aaa8f3ab54ab0b19cc16317eb488d/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.753854 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97401f5a19b4170b00e9f6300b0ea22, user_id=bc7aaa8f3ab54ab0b19cc16317eb488d, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.756623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.770250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1269/2563] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:55 2022] PUT /identity/v3/projects/d97401f5a19b4170b00e9f6300b0ea22/users/bc7aaa8f3ab54ab0b19cc16317eb488d/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:55.774395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.784275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1e082-36c7-435c-957a-8188ffcbb09e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.840807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50808616-0f72-47ba-8b48-edf009b82969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.841501 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808616-0f72-47ba-8b48-edf009b82969 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.841745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808616-0f72-47ba-8b48-edf009b82969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.842022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50808616-0f72-47ba-8b48-edf009b82969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.842749 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50808616-0f72-47ba-8b48-edf009b82969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.844374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50808616-0f72-47ba-8b48-edf009b82969 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.858682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1295/2564] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:55.859872 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:55.870045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0a0c-6098-45f9-8789-482b909370bd admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:55.874676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:55.875583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.875862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.876129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] PATH_INFO: `/v3/projects/d97401f5a19b4170b00e9f6300b0ea22/users/bc7aaa8f3ab54ab0b19cc16317eb488d/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.878091 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97401f5a19b4170b00e9f6300b0ea22, user_id=bc7aaa8f3ab54ab0b19cc16317eb488d, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:55.880868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:55.890713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1270/2565] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:55 2022] PUT /identity/v3/projects/d97401f5a19b4170b00e9f6300b0ea22/users/bc7aaa8f3ab54ab0b19cc16317eb488d/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:55.901350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:55.901608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:55.901882 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:55.930454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] MFA Rules not processed for user `bc7aaa8f3ab54ab0b19cc16317eb488d`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:55.931694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:55.998668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1296/2566] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:56.010341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:56.012167 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:56.072278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a20100-cda7-4502-bb94-68f5e9bbc43c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:56.078446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc1aa-485a-4e44-b955-3aa1b4bf9e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:56.079499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc1aa-485a-4e44-b955-3aa1b4bf9e4f service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:56.080010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc1aa-485a-4e44-b955-3aa1b4bf9e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:56.080443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc1aa-485a-4e44-b955-3aa1b4bf9e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:56.092047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc1aa-485a-4e44-b955-3aa1b4bf9e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:56.094176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc1aa-485a-4e44-b955-3aa1b4bf9e4f service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:56.109044 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1271/2567] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:56.137019 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:56.210301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f73b-6255-41f2-be15-44986f53132e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:56.215296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:56.216178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:56.216459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:56.216727 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] PATH_INFO: `/v3/users/91e16658279f4a6fa0822c1f533afa44` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:56.217931 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e16658279f4a6fa0822c1f533afa44)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:56.219919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:56.267690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e16658279f4a6fa0822c1f533afa44'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.276876 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e16658279f4a6fa0822c1f533afa44'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.283599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e16658279f4a6fa0822c1f533afa44'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.284277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e16658279f4a6fa0822c1f533afa44'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.284920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e16658279f4a6fa0822c1f533afa44'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.302402 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1297/2568] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:56 2022] DELETE /identity/v3/users/91e16658279f4a6fa0822c1f533afa44 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:56.307004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:56.307292 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:56.307552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:56.324876 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:56.326042 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:56.397977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1272/2569] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:56.408449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:56.409948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:56.467388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8514296-16a8-4766-a5ba-eae7ba9f098f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:56.471585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:56.472227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:56.472497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:56.472788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:56.482125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:56.483605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:56.493055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1298/2570] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:56.765555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:56.767190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:56.780579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fb9dd-f29f-4b6d-a797-29592a977781 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:56.786088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:56.787121 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:56.787405 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:56.787674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] PATH_INFO: `/v3/projects/80c56f6316db4879a3f954d6744787dc` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:56.788987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c56f6316db4879a3f954d6744787dc)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:56.790906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:56.841540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c56f6316db4879a3f954d6744787dc', 'request_id': 'req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.848316 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c56f6316db4879a3f954d6744787dc', 'request_id': 'req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.856479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c56f6316db4879a3f954d6744787dc', 'request_id': 'req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.869997 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] The token cache is being invalidate because project 80c56f6316db4879a3f954d6744787dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:56.870498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.870959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:56.872672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1273/2571] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:56 2022] DELETE /identity/v3/projects/80c56f6316db4879a3f954d6744787dc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:56.876982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:56.886941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150e7b5-5c71-43af-84cd-11d0bd0c88f6 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:56.945488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:56.946442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:56.946783 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:56.947148 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] PATH_INFO: `/v3/users/bc7aaa8f3ab54ab0b19cc16317eb488d` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:56.948324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7aaa8f3ab54ab0b19cc16317eb488d)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:56.950266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:56.996443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7aaa8f3ab54ab0b19cc16317eb488d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.005390 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7aaa8f3ab54ab0b19cc16317eb488d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.013577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7aaa8f3ab54ab0b19cc16317eb488d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.014250 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7aaa8f3ab54ab0b19cc16317eb488d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.014954 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f710a3cd-f248-4c36-badc-ea588d9c0fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7aaa8f3ab54ab0b19cc16317eb488d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.033395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1299/2572] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:56 2022] DELETE /identity/v3/users/bc7aaa8f3ab54ab0b19cc16317eb488d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:57.384495 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.385952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:57.401075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9afe8b-0ae0-4a7a-9c2a-07eba80c145e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.458811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.459737 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.460007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.460273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] PATH_INFO: `/v3/projects/d97401f5a19b4170b00e9f6300b0ea22` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.461563 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97401f5a19b4170b00e9f6300b0ea22)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.463564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.511305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97401f5a19b4170b00e9f6300b0ea22', 'request_id': 'req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.517762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97401f5a19b4170b00e9f6300b0ea22', 'request_id': 'req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.526350 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97401f5a19b4170b00e9f6300b0ea22', 'request_id': 'req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.537159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] The token cache is being invalidate because project d97401f5a19b4170b00e9f6300b0ea22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:57.537464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.538105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4ba06fa2-f0e2-4bae-8665-73ac47f88a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:57.539697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1274/2573] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:57 2022] DELETE /identity/v3/projects/d97401f5a19b4170b00e9f6300b0ea22 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:57.544862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.545151 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.545423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.565170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:57.566356 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:57.628280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1300/2574] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:57.636573 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.636894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.637158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.656471 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:57.657657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:57.666090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1275/2575] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:57.671354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.682014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaff49-5441-41a2-bc5e-00e73edd2911 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.687329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.688000 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.688276 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.688540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.689340 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:23:57.689637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.691266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.702948 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1301/2576] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:23:57.707366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.717087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20eb17-8836-4633-87b5-60f388d5172c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.723059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.723712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.723994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.724266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.724973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.726916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.756058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1276/2577] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:57 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:57.762726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.776017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428e09-a244-43cc-8f0a-571dafc1b35c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.835169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.835833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.836112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.836404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.837086 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.839037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.859316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1302/2578] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:57 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:57.863651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.874309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17935ba2-022b-40e2-a263-77b1837f9b95 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.879470 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.880117 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.880393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.880657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.881371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.882981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.894589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1277/2579] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:57.898969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.909232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371021b-667c-46d5-8087-150fac29e770 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.914166 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875e03b-85cb-4032-b6ba-9793cc8bd9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.914820 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e03b-85cb-4032-b6ba-9793cc8bd9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.915132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e03b-85cb-4032-b6ba-9793cc8bd9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.915739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e03b-85cb-4032-b6ba-9793cc8bd9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.916099 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875e03b-85cb-4032-b6ba-9793cc8bd9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.917691 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875e03b-85cb-4032-b6ba-9793cc8bd9c0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.929610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1303/2580] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:57.934445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:57.944994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b354d9-0aaf-4e32-b7d5-c371c6f63488 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:57.951491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:57.952367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.952639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.952907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] PATH_INFO: `/v3/projects/40cf3bfc41114bbb94335fb872264203/users/8a236e49c9bf4ba4ac3b89f989f701e0/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:57.967824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cf3bfc41114bbb94335fb872264203, user_id=8a236e49c9bf4ba4ac3b89f989f701e0, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:57.970486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:57.983663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1278/2581] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:57 2022] PUT /identity/v3/projects/40cf3bfc41114bbb94335fb872264203/users/8a236e49c9bf4ba4ac3b89f989f701e0/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:57.994941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:57.995232 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:57.995504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.023779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] MFA Rules not processed for user `8a236e49c9bf4ba4ac3b89f989f701e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:58.024986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:58.093448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1304/2582] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:58.098387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.159998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb60622-7532-4383-8c66-7d06def8ddaf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.164712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.165367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.165645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.165920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.166594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.168521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.195300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1279/2583] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:23:58 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:23:58.200051 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.212202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcdce1-b1d8-4483-bc43-1f4dc1c3d3ca None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.279320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.279986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.280266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.280538 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.281229 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.283559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.305427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1305/2584] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:23:58 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:23:58.309341 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.320308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257cdc9-8127-4c53-9d1d-d435ea8d4582 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.325480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.325753 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.326069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.326339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.327392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.328982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.343845 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1280/2585] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:58.345141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.355376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947252c9-ed2e-4fe3-b6a1-70f55a865252 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.362665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.364430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.364430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.364430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] PATH_INFO: `/v3/projects/a5b543e355554028816a754db8793e8d/users/65f6fd7985144343b7a654c3077b373e/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.380188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b543e355554028816a754db8793e8d, user_id=65f6fd7985144343b7a654c3077b373e, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.383420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.402524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1306/2586] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:58 2022] PUT /identity/v3/projects/a5b543e355554028816a754db8793e8d/users/65f6fd7985144343b7a654c3077b373e/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:23:58.404938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.418335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9f7ea-6d69-4533-898e-542fc840c6cd admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.492377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc555520-683d-4c82-8fd9-2d6f0d69a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.493122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555520-683d-4c82-8fd9-2d6f0d69a115 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.493406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555520-683d-4c82-8fd9-2d6f0d69a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.493677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc555520-683d-4c82-8fd9-2d6f0d69a115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.494402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc555520-683d-4c82-8fd9-2d6f0d69a115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.496022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc555520-683d-4c82-8fd9-2d6f0d69a115 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.507478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1281/2587] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:23:58.511992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.528563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81461e7a-bb1d-4123-a982-7de50cf34a0a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.533324 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.534161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.534441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.534740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] PATH_INFO: `/v3/projects/a5b543e355554028816a754db8793e8d/users/65f6fd7985144343b7a654c3077b373e/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.536884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b543e355554028816a754db8793e8d, user_id=65f6fd7985144343b7a654c3077b373e, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.539646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.556539 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1307/2588] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:23:58 2022] PUT /identity/v3/projects/a5b543e355554028816a754db8793e8d/users/65f6fd7985144343b7a654c3077b373e/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:58.566973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.567250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.567521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.598185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] MFA Rules not processed for user `65f6fd7985144343b7a654c3077b373e`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:58.600027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:58.676538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1282/2589] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:58.687987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.690091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:58.751549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b246cf5-c59c-48d3-9aed-853e758889b6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.755802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad293c-7295-46e3-8fe4-472a0fbac1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.756447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad293c-7295-46e3-8fe4-472a0fbac1fe service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.756725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad293c-7295-46e3-8fe4-472a0fbac1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.756992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad293c-7295-46e3-8fe4-472a0fbac1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.766682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad293c-7295-46e3-8fe4-472a0fbac1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.768263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad293c-7295-46e3-8fe4-472a0fbac1fe service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.777814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1308/2590] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:58.841523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:58.921915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490957d-520f-4d7a-844d-380a4a6435fc None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:58.927827 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:58.928884 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:58.929228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:58.929585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] PATH_INFO: `/v3/users/8a236e49c9bf4ba4ac3b89f989f701e0` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:58.931113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a236e49c9bf4ba4ac3b89f989f701e0)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:58.933083 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:58.984539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a236e49c9bf4ba4ac3b89f989f701e0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:58.992318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a236e49c9bf4ba4ac3b89f989f701e0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:58.999099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a236e49c9bf4ba4ac3b89f989f701e0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.000004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a236e49c9bf4ba4ac3b89f989f701e0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.012498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a236e49c9bf4ba4ac3b89f989f701e0'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.018547 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1283/2591] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:58 2022] DELETE /identity/v3/users/8a236e49c9bf4ba4ac3b89f989f701e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:59.023320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:59.023793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:59.023903 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:59.042004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:23:59.043141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:59.103780 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1309/2592] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:23:59.114291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:59.115830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:59.177606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68355e-776f-43c8-8609-8c478a702892 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:59.182263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:59.182921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:59.183211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:59.183481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:59.193998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:59.195602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:59.206466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1284/2593] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:23:59.484096 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:59.485484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:23:59.511031 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f4269-9756-4e6f-839d-fe6865d3ada7 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:59.518809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:59.519736 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:59.519894 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:59.520187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] PATH_INFO: `/v3/projects/40cf3bfc41114bbb94335fb872264203` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:59.521421 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cf3bfc41114bbb94335fb872264203)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:59.523380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:59.574577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cf3bfc41114bbb94335fb872264203', 'request_id': 'req-af18ca2f-6790-45d2-9c53-298ca5cef63c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.583057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cf3bfc41114bbb94335fb872264203', 'request_id': 'req-af18ca2f-6790-45d2-9c53-298ca5cef63c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.589346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cf3bfc41114bbb94335fb872264203', 'request_id': 'req-af18ca2f-6790-45d2-9c53-298ca5cef63c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.599863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] The token cache is being invalidate because project 40cf3bfc41114bbb94335fb872264203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:23:59.600144 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.600803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.602579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1310/2594] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:23:59 2022] DELETE /identity/v3/projects/40cf3bfc41114bbb94335fb872264203 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:23:59.606687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:23:59.616554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2975e-c7b5-4a45-8da2-d283addb689c service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:23:59.679739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:23:59.680666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:23:59.680946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:23:59.681238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] PATH_INFO: `/v3/users/65f6fd7985144343b7a654c3077b373e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:23:59.682483 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f6fd7985144343b7a654c3077b373e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:23:59.684436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:23:59.730289 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f6fd7985144343b7a654c3077b373e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.737381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f6fd7985144343b7a654c3077b373e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.745580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f6fd7985144343b7a654c3077b373e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.746308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f6fd7985144343b7a654c3077b373e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.757949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-2c8820d3-867d-4b49-9402-48a7db70f613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f6fd7985144343b7a654c3077b373e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:23:59.764018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1285/2595] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:23:59 2022] DELETE /identity/v3/users/65f6fd7985144343b7a654c3077b373e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:00.037073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.038565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:00.054257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ca2f-6790-45d2-9c53-298ca5cef63c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.117404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.118362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.118638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.118925 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] PATH_INFO: `/v3/projects/a5b543e355554028816a754db8793e8d` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.120546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b543e355554028816a754db8793e8d)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.122792 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.169961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b543e355554028816a754db8793e8d', 'request_id': 'req-d646ae0a-3e8e-4918-9e49-8026b130236e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:00.178467 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b543e355554028816a754db8793e8d', 'request_id': 'req-d646ae0a-3e8e-4918-9e49-8026b130236e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:00.185254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b543e355554028816a754db8793e8d', 'request_id': 'req-d646ae0a-3e8e-4918-9e49-8026b130236e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:00.196460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] The token cache is being invalidate because project a5b543e355554028816a754db8793e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:00.196753 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:00.197476 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-d646ae0a-3e8e-4918-9e49-8026b130236e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:00.199041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1311/2596] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:00 2022] DELETE /identity/v3/projects/a5b543e355554028816a754db8793e8d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:00.203963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.204385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.204581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.231962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:00.233240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:00.298920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1286/2597] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:00.307028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.307349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.307628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.326852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:00.328101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:00.336061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1312/2598] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:00.340336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.349883 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09872f90-fdf9-4d1e-bb88-db8331dceb09 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.354721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.355418 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.355697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.355962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.356675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:00.357173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.358527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.370132 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1287/2599] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:00.374661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.384529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcf510-e6ea-4522-bf09-cd217738cbd9 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.389589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.390255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.390585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.390856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.391647 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.393645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.422542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1313/2600] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:00.427415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.437448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f115fd-d181-45d9-bad3-1937b49a1d26 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.497127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.497819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.498098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.498368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.499095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.501278 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.524542 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1288/2601] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:00.528680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.540565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6a7b8-4571-4b5c-9f48-360e20dddc6b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.545993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.546694 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.547013 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.547287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.548022 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.549645 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.561377 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1314/2602] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:00.565611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.575994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a1833-4e2f-4b8a-9f98-b14a73788496 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.581309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc7d71-c34f-4494-bc47-c0f8eec22762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.582004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7d71-c34f-4494-bc47-c0f8eec22762 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.582460 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7d71-c34f-4494-bc47-c0f8eec22762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.582749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7d71-c34f-4494-bc47-c0f8eec22762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.583505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc7d71-c34f-4494-bc47-c0f8eec22762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.585110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc7d71-c34f-4494-bc47-c0f8eec22762 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.599427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1289/2603] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:00.600313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.611655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194c172-64f4-485f-8fd2-1eb4b7f52623 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.616985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.617892 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.618171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.618444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] PATH_INFO: `/v3/projects/80d0450af36e47778a6d8914a4ec46e4/users/0e4bed9e5af94619b0798523b92e0edd/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.635035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d0450af36e47778a6d8914a4ec46e4, user_id=0e4bed9e5af94619b0798523b92e0edd, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.637994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.655571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1315/2604] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:00 2022] PUT /identity/v3/projects/80d0450af36e47778a6d8914a4ec46e4/users/0e4bed9e5af94619b0798523b92e0edd/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:00.664733 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.665385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.665535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.713061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] MFA Rules not processed for user `0e4bed9e5af94619b0798523b92e0edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:00.714360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:00.792889 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1290/2605] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:00.797537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.870722 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1b64-67e9-4b8e-a6bd-087bce5263b2 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.875839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.876461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.876737 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.877002 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.877682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.879649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:00.910679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1316/2606] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:00.911973 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:00.923539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dec66-e477-428a-956b-4ea9f90a39a3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:00.982807 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:00.983663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:00.984074 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:00.984348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:00.985060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:00.987006 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.008996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1291/2607] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:00 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:01.013127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.023554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8310c-4613-4d9c-b759-638ae016d77a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.039123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.039825 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.040286 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.040555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.041293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.042960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.054330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1317/2608] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:01.058540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.068818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00768852-2f3d-4ab1-a326-613e5192bc41 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.073966 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.074952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.075340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.075617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] PATH_INFO: `/v3/projects/519990b3c5e442aa90112ee3dea9dcad/users/906555900bdd4c9493d6d23bfe285d8e/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.091668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519990b3c5e442aa90112ee3dea9dcad, user_id=906555900bdd4c9493d6d23bfe285d8e, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.094352 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.110560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1292/2609] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:01 2022] PUT /identity/v3/projects/519990b3c5e442aa90112ee3dea9dcad/users/906555900bdd4c9493d6d23bfe285d8e/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:01.114625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.124941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18095-1396-4acd-938a-09ee2b368703 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.180412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c6558-214f-4a2c-9c92-a55dcf3be50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.181001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6558-214f-4a2c-9c92-a55dcf3be50b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.181282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6558-214f-4a2c-9c92-a55dcf3be50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.181552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6558-214f-4a2c-9c92-a55dcf3be50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.182274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c6558-214f-4a2c-9c92-a55dcf3be50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.183898 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c6558-214f-4a2c-9c92-a55dcf3be50b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.193855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1318/2610] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:01.198009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.208119 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fe87-e741-4a30-9c5c-02680d12a097 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.212993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.213873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.214145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.214408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] PATH_INFO: `/v3/projects/519990b3c5e442aa90112ee3dea9dcad/users/906555900bdd4c9493d6d23bfe285d8e/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.216415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519990b3c5e442aa90112ee3dea9dcad, user_id=906555900bdd4c9493d6d23bfe285d8e, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.219086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.229524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1293/2611] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:01 2022] PUT /identity/v3/projects/519990b3c5e442aa90112ee3dea9dcad/users/906555900bdd4c9493d6d23bfe285d8e/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:01.239721 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.240008 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.240280 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.266133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] MFA Rules not processed for user `906555900bdd4c9493d6d23bfe285d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:01.267401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:01.346128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1319/2612] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:01.358661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.360473 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:01.456794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b25c3-0826-4626-86c5-e4ed76bfd3e0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.460873 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.461610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.461974 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.462312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.473175 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.474689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.495052 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1294/2613] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:01.607256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.608950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:01.622111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3a8ac-3c21-4a93-a31c-1acba6373f1d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.626457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592f85c-f48c-403d-9371-6920d263c86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.627351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592f85c-f48c-403d-9371-6920d263c86a service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.627724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592f85c-f48c-403d-9371-6920d263c86a service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.628131 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592f85c-f48c-403d-9371-6920d263c86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.696893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592f85c-f48c-403d-9371-6920d263c86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.698237 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592f85c-f48c-403d-9371-6920d263c86a service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.707832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1320/2614] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:01.736251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:01.737862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:01.814911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca79b34-8ffd-4c87-8757-a419e4218296 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:01.819570 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:01.820578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.820946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.821217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] PATH_INFO: `/v3/users/c78052b2f37546d39483cec0504bfa8d` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.822429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78052b2f37546d39483cec0504bfa8d)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:01.824384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:01.897524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78052b2f37546d39483cec0504bfa8d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:01.907860 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78052b2f37546d39483cec0504bfa8d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:01.924408 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78052b2f37546d39483cec0504bfa8d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:01.925869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78052b2f37546d39483cec0504bfa8d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:01.946274 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78052b2f37546d39483cec0504bfa8d'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:01.954261 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1295/2615] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:01 2022] DELETE /identity/v3/users/c78052b2f37546d39483cec0504bfa8d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:01.958803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:01.959124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:01.959401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:01.987155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:01.988411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:02.080395 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1321/2616] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:02.092098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.093900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:02.173038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891966ff-4bca-41d4-8c23-bb83a8249a16 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.177507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180b8aa-8c49-4ac3-aadc-eccbb6d21f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.177655 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b8aa-8c49-4ac3-aadc-eccbb6d21f2c service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.177911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b8aa-8c49-4ac3-aadc-eccbb6d21f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.178231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180b8aa-8c49-4ac3-aadc-eccbb6d21f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.189633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b8aa-8c49-4ac3-aadc-eccbb6d21f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.191312 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180b8aa-8c49-4ac3-aadc-eccbb6d21f2c service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.202687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1296/2617] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:02.480140 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.481585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:02.502817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9a97-c26d-4aa5-b29b-36dc535e604e None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.507693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.508567 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.508883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.509174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] PATH_INFO: `/v3/projects/c1067ec3f1b641cc8ef8d5ab8b370389` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.510473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1067ec3f1b641cc8ef8d5ab8b370389)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.512517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.562164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1067ec3f1b641cc8ef8d5ab8b370389', 'request_id': 'req-49f9547d-9b42-4ab4-a292-903f3624e1a5'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:02.569564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1067ec3f1b641cc8ef8d5ab8b370389', 'request_id': 'req-49f9547d-9b42-4ab4-a292-903f3624e1a5'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:02.576201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1067ec3f1b641cc8ef8d5ab8b370389', 'request_id': 'req-49f9547d-9b42-4ab4-a292-903f3624e1a5'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:02.586380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] The token cache is being invalidate because project c1067ec3f1b641cc8ef8d5ab8b370389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:02.586663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:02.587345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-49f9547d-9b42-4ab4-a292-903f3624e1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:02.588883 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1322/2618] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:02 2022] DELETE /identity/v3/projects/c1067ec3f1b641cc8ef8d5ab8b370389 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:02.593799 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.594078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.594348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.615595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:02.616763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:02.676087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1297/2619] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:02.684074 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.684446 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.684779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.703502 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:02.704682 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:02.713117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1323/2620] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:02.717336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.727188 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7ab75-c23c-4e4a-b64f-29c32fcf9749 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.732136 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.732830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.733095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.733368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.734087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:02.734387 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.736016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.747529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1298/2621] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:02.751900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.761863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57facdcf-9665-4c3d-8fd6-e943e9e1c3c0 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.768339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.768983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.769257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.769520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.770189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.772128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.804453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1324/2622] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:02 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:02.805710 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.815930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28202c1c-5c85-4fa3-b9e3-6e1b556b33b9 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.875745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.876403 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.876680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.876949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.877610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.879577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.901266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1299/2623] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:02 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:02.905368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.915774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c677-8135-46b0-9d4d-9f01b2de7f6d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.921127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.922596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.923133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.923591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.925312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.927969 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.939180 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1325/2624] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:02.943300 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.953775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27465d28-ccf7-453b-864c-67fc4961e109 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.959816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51134b-c52a-43cc-a71a-dd90f479024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.960476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51134b-c52a-43cc-a71a-dd90f479024d admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.960751 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51134b-c52a-43cc-a71a-dd90f479024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.961017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51134b-c52a-43cc-a71a-dd90f479024d admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:02.961735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51134b-c52a-43cc-a71a-dd90f479024d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:02.963401 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51134b-c52a-43cc-a71a-dd90f479024d admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:02.973659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1300/2625] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:02.977823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:02.988526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf626b6-38c7-4de8-88ea-02436e39562a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:02.994245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:02.995147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:02.995428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:02.995699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] PATH_INFO: `/v3/projects/d0212803885f4afb939e59c7cae616e9/users/195323636338415697a68917eae78304/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.011220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0212803885f4afb939e59c7cae616e9, user_id=195323636338415697a68917eae78304, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.013902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.029094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1326/2626] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:02 2022] PUT /identity/v3/projects/d0212803885f4afb939e59c7cae616e9/users/195323636338415697a68917eae78304/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:03.039579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.039868 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.040128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.068174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] MFA Rules not processed for user `195323636338415697a68917eae78304`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:03.069415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:03.137064 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1301/2627] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:03.141209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.203809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215ca50-9405-4fa7-ac97-0e5cd2db5b28 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.208589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.209247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.209526 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.209797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.210480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.212561 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.242195 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1327/2628] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:03 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:03.243514 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.254464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09861fda-8125-4a69-921e-7fbcb5fed79e None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.325788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.326594 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.327005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.327425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.328214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.330232 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.350931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1302/2629] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:03 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:03.354525 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.364619 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebff4bf-bc6a-4fae-83a9-bcc0652fa09c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.369279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.369942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.370221 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.370486 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.371241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.372844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.384517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1328/2630] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:03.388617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.403214 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413cc44-c836-4336-9556-ff7d704a3b65 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.409551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1081beb-a85d-47f9-ab1d-e33680e6b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.410323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081beb-a85d-47f9-ab1d-e33680e6b89b admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.410623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081beb-a85d-47f9-ab1d-e33680e6b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.410898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1081beb-a85d-47f9-ab1d-e33680e6b89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.411656 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1081beb-a85d-47f9-ab1d-e33680e6b89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.413539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1081beb-a85d-47f9-ab1d-e33680e6b89b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.426962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1303/2631] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:03.428772 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.439864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67f2a-8e9e-482b-a9f2-8e08bf343321 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.444725 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.445671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.446004 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.446344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] PATH_INFO: `/v3/projects/4d2d5022ccca4a32aad3313f94509fb7/users/71a8287f606345948f9d0fcaa40185d1/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.461349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2d5022ccca4a32aad3313f94509fb7, user_id=71a8287f606345948f9d0fcaa40185d1, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.464217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.478497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1329/2632] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:03 2022] PUT /identity/v3/projects/4d2d5022ccca4a32aad3313f94509fb7/users/71a8287f606345948f9d0fcaa40185d1/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:03.489690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.490051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.490332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.519036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] MFA Rules not processed for user `71a8287f606345948f9d0fcaa40185d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:03.520279 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:03.584834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1304/2633] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:03.589592 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.663634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4f80a-b4c3-4177-a222-5da43618afd9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.664972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.665634 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.665915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.666185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.666968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.668840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.697875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1330/2634] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:03 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:03.699139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.709880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0253d15-5a5e-4201-9aca-d4804d20e39d None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.772084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.772780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.773029 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.773301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.773986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.775996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.796938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1305/2635] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:03 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:03.801342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.813271 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a323c-e786-4aa7-a479-c4316f73eb2d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.818179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.818901 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.819279 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.819453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.820317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.821910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.833139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1331/2636] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:03.837339 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.847306 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3d1c5-3b53-4f89-a9b6-4a7ad449b23e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.852222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.853104 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.853392 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.853663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] PATH_INFO: `/v3/projects/ed87a252c74940e58e172010ce8597ad/users/aa9313d29df34e83bd57365635c577b5/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.868309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed87a252c74940e58e172010ce8597ad, user_id=aa9313d29df34e83bd57365635c577b5, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.871034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.885003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1306/2637] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:03 2022] PUT /identity/v3/projects/ed87a252c74940e58e172010ce8597ad/users/aa9313d29df34e83bd57365635c577b5/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:03.888867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.898818 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f260b26-9f7b-4144-89d7-4f414fe0bf8c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.957705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136944e5-48c2-4cb4-8071-bac3b2a6d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.958350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136944e5-48c2-4cb4-8071-bac3b2a6d024 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.958631 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136944e5-48c2-4cb4-8071-bac3b2a6d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.958916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136944e5-48c2-4cb4-8071-bac3b2a6d024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.959652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136944e5-48c2-4cb4-8071-bac3b2a6d024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.961309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136944e5-48c2-4cb4-8071-bac3b2a6d024 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:03.970933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1332/2638] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:03.975317 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:03.986060 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05c8a5-28a1-44d0-996e-30d264876525 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:03.991596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:03.992493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:03.992769 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:03.993040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] PATH_INFO: `/v3/projects/ed87a252c74940e58e172010ce8597ad/users/aa9313d29df34e83bd57365635c577b5/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:03.995244 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed87a252c74940e58e172010ce8597ad, user_id=aa9313d29df34e83bd57365635c577b5, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:03.997916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:04.008690 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1307/2639] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:03 2022] PUT /identity/v3/projects/ed87a252c74940e58e172010ce8597ad/users/aa9313d29df34e83bd57365635c577b5/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:04.019718 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7db8-2184-40d2-ad87-8c4f9fc06a2f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:04.019987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7db8-2184-40d2-ad87-8c4f9fc06a2f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:04.020259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7db8-2184-40d2-ad87-8c4f9fc06a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:04.047703 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-59ab7db8-2184-40d2-ad87-8c4f9fc06a2f None None] MFA Rules not processed for user `aa9313d29df34e83bd57365635c577b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:04.048872 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-59ab7db8-2184-40d2-ad87-8c4f9fc06a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:04.119334 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1333/2640] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:04.131038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:04.132879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:04.192301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45282cb7-f315-4940-ae9e-d891dabeb755 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:04.196236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:04.196918 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:04.197258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:04.197505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:04.255835 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:04.257216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:04.265972 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1308/2641] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:05.738612 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:05.739145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:05.739145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:05.758169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] MFA Rules not processed for user `c473be73cf814903b46d7d95182c5838`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:05.759806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:05.795574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:05.797348 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:05.810586 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c3ae7-76c2-4ac5-99cc-e62cdd738ff8 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:05.814479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:05.815152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:05.815613 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:05.815879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:05.825344 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1334/2642] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:05.882262 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:05.883757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:05.894226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1309/2643] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:06.552665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:06.563354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ad8b4-e435-4bcc-b4d9-d6883c24f2bd None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:06.567479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:06.568328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:06.568614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:06.568887 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:06.580157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:06.582412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:06.593282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1335/2644] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:07.280910 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:07.282302 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:07.341428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb23b6-24ea-4db4-9c20-332529fc9125 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:07.345151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:07.345796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:07.346071 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:07.346343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:07.348191 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:07.418275 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:07.420099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878df646-6c72-4fa6-9f65-36c93e58ab8e service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:07.431948 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1310/2645] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:08.789137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:08.790563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:08.809923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebff1f8-5a83-4e73-bc30-996ad79ea7f1 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:08.815345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:08.816666 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:08.817199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:08.817667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] PATH_INFO: `/v3/users/0e4bed9e5af94619b0798523b92e0edd` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:08.819150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4bed9e5af94619b0798523b92e0edd)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:08.821368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:08.880961 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4bed9e5af94619b0798523b92e0edd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:08.893161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4bed9e5af94619b0798523b92e0edd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:08.909987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4bed9e5af94619b0798523b92e0edd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:08.911092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4bed9e5af94619b0798523b92e0edd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:08.911635 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4bed9e5af94619b0798523b92e0edd'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:08.933735 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1336/2646] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:08 2022] DELETE /identity/v3/users/0e4bed9e5af94619b0798523b92e0edd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:08.938130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:08.938622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:08.939213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:08.957187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:08.958529 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:09.018493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1311/2647] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:09.030147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:09.031628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:09.132659 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7125a-ad32-4801-be18-ba7e49151ab9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:09.138911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:09.139699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:09.140679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:09.140679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:09.155188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:09.157950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:09.173411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1337/2648] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:09.653024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:09.657273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:09.687607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77515f34-355a-4a6d-922f-5d55bb2b1ed2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:09.692976 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:09.694237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:09.694828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:09.695370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] PATH_INFO: `/v3/projects/80d0450af36e47778a6d8914a4ec46e4` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:09.696861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d0450af36e47778a6d8914a4ec46e4)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:09.699399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:09.761005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d0450af36e47778a6d8914a4ec46e4', 'request_id': 'req-b7e83189-548f-4b1f-87e3-44eb63e9db60'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.768305 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d0450af36e47778a6d8914a4ec46e4', 'request_id': 'req-b7e83189-548f-4b1f-87e3-44eb63e9db60'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.776811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d0450af36e47778a6d8914a4ec46e4', 'request_id': 'req-b7e83189-548f-4b1f-87e3-44eb63e9db60'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.790919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] The token cache is being invalidate because project 80d0450af36e47778a6d8914a4ec46e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:09.791427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.792237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.794689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1312/2649] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:09 2022] DELETE /identity/v3/projects/80d0450af36e47778a6d8914a4ec46e4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:09.798962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:09.811744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d23a57-9129-4501-abd0-3f2f69d748cb service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:09.875472 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:09.876361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:09.876829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:09.877248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] PATH_INFO: `/v3/users/906555900bdd4c9493d6d23bfe285d8e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:09.878603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=906555900bdd4c9493d6d23bfe285d8e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:09.880817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:09.945886 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '906555900bdd4c9493d6d23bfe285d8e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.955354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '906555900bdd4c9493d6d23bfe285d8e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.964420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '906555900bdd4c9493d6d23bfe285d8e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.965186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '906555900bdd4c9493d6d23bfe285d8e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.965830 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-51adaacf-c4e3-4c42-9672-15cca97219bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '906555900bdd4c9493d6d23bfe285d8e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:09.994078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1338/2650] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:09 2022] DELETE /identity/v3/users/906555900bdd4c9493d6d23bfe285d8e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:10.357041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.358517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.372526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e83189-548f-4b1f-87e3-44eb63e9db60 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.438449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.439434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.439772 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.440099 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] PATH_INFO: `/v3/projects/519990b3c5e442aa90112ee3dea9dcad` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.441372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519990b3c5e442aa90112ee3dea9dcad)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.443383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.491051 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519990b3c5e442aa90112ee3dea9dcad', 'request_id': 'req-12633f42-42c1-4f05-9b9f-06854b56e7b4'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.496941 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519990b3c5e442aa90112ee3dea9dcad', 'request_id': 'req-12633f42-42c1-4f05-9b9f-06854b56e7b4'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.505491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519990b3c5e442aa90112ee3dea9dcad', 'request_id': 'req-12633f42-42c1-4f05-9b9f-06854b56e7b4'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.515581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] The token cache is being invalidate because project 519990b3c5e442aa90112ee3dea9dcad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:10.515870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.516544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.518049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1313/2651] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:10 2022] DELETE /identity/v3/projects/519990b3c5e442aa90112ee3dea9dcad => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:10.523999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff4b0-d3d4-41e9-9fe6-86e50a5c58fe None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.524228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff4b0-d3d4-41e9-9fe6-86e50a5c58fe None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.524674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aff4b0-d3d4-41e9-9fe6-86e50a5c58fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.545851 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-a3aff4b0-d3d4-41e9-9fe6-86e50a5c58fe None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:10.547628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-a3aff4b0-d3d4-41e9-9fe6-86e50a5c58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.632838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.634225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.639436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1339/2652] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:10.648580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.648972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.649415 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.656190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12633f42-42c1-4f05-9b9f-06854b56e7b4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.662459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.663676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.664176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.664953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] PATH_INFO: `/v3/users/195323636338415697a68917eae78304` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.667199 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=195323636338415697a68917eae78304)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.669617 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:10.670648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.671247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.685461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1340/2653] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:10.687885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.702653 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea5b9b-b9ac-4369-b95a-2d0b800bda14 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.708869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.709840 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.710365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.710823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.712156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:10.713330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.715590 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.736664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195323636338415697a68917eae78304'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.738733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1341/2654] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:10.743750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.749024 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195323636338415697a68917eae78304'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.755477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb78d41-be12-4ca6-b5b3-1884e27b61d1 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.757372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195323636338415697a68917eae78304'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.758170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195323636338415697a68917eae78304'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.760847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.762170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.762713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.763081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.763998 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.765988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.771780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-68d1b61b-d932-4d0e-b5d1-e0c10719bfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195323636338415697a68917eae78304'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:10.778513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1314/2655] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:10 2022] DELETE /identity/v3/users/195323636338415697a68917eae78304 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:10.783294 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.783631 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.783909 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.801309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1342/2656] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:10 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:10.806755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.808627 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.809705 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:10.810870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.876527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2a7d4-fbdf-4fec-b44e-8518014ff285 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.879870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1315/2657] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:10.881435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.882112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.882427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.882676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.883587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.885317 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.889938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.891723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:10.910335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1343/2658] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:10 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:10.911822 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.922865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170012-906b-4a27-a5a2-bfaa6435094b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.929563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.930769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.931308 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.931671 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.932761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.934483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.945186 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1344/2659] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:10.949034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:10.961579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096079ea-1e2c-4651-a97b-ec1ae8136e76 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.961851 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466bafd-9e47-4673-b305-144894e8a472 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:10.969833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93999974-55a2-44d4-913c-730679121140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.970527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999974-55a2-44d4-913c-730679121140 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.970811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999974-55a2-44d4-913c-730679121140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.971110 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93999974-55a2-44d4-913c-730679121140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.975430 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:10.976103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:10.976384 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:10.976655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:10.977628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.979404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.989589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93999974-55a2-44d4-913c-730679121140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:10.991894 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93999974-55a2-44d4-913c-730679121140 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:10.997861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1345/2660] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:10.998946 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:11.003229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1316/2661] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:11.011364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28ef68-0327-4ce6-9294-5779d63cab72 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:11.016373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:11.017407 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:11.017781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:11.018146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] PATH_INFO: `/v3/projects/0941c59bdbd249ffb9c55466b50677df/users/780af0cfe890480e8b69bb8ad9e492d8/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:11.044960 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941c59bdbd249ffb9c55466b50677df, user_id=780af0cfe890480e8b69bb8ad9e492d8, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:11.048508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:11.072762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1346/2662] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:10 2022] PUT /identity/v3/projects/0941c59bdbd249ffb9c55466b50677df/users/780af0cfe890480e8b69bb8ad9e492d8/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:11.083811 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:11.084105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:11.084375 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:11.121122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] MFA Rules not processed for user `780af0cfe890480e8b69bb8ad9e492d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:11.123055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:11.221458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1317/2663] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:11.233569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:11.235357 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:11.295404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c984-972a-4c5c-92b8-65e8a4befc85 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:11.299649 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:11.300664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:11.301081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:11.301397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:11.327222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:11.329644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:11.340849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1347/2664] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:11.430280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:11.431936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:11.547085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9fbd-4f52-4f71-b644-670d053bf6d0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:11.556079 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:11.558446 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:11.558993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:11.560240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] PATH_INFO: `/v3/projects/d0212803885f4afb939e59c7cae616e9` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:11.562727 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0212803885f4afb939e59c7cae616e9)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:11.570287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:11.629853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0212803885f4afb939e59c7cae616e9', 'request_id': 'req-b5951c3b-1d42-459f-85c9-9bd13f03f69a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.637763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0212803885f4afb939e59c7cae616e9', 'request_id': 'req-b5951c3b-1d42-459f-85c9-9bd13f03f69a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.647672 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0212803885f4afb939e59c7cae616e9', 'request_id': 'req-b5951c3b-1d42-459f-85c9-9bd13f03f69a'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.661969 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] The token cache is being invalidate because project d0212803885f4afb939e59c7cae616e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:11.662404 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.663962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.667153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1318/2665] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:11 2022] DELETE /identity/v3/projects/d0212803885f4afb939e59c7cae616e9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:11.670414 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:11.691391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b0027-5dd0-4599-b7f6-f0cf84a381d0 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:11.783018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:11.784425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:11.784875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:11.785236 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] PATH_INFO: `/v3/users/71a8287f606345948f9d0fcaa40185d1` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:11.787495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a8287f606345948f9d0fcaa40185d1)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:11.789636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:11.847951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a8287f606345948f9d0fcaa40185d1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.878439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a8287f606345948f9d0fcaa40185d1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.886609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a8287f606345948f9d0fcaa40185d1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.887569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a8287f606345948f9d0fcaa40185d1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.888223 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a8287f606345948f9d0fcaa40185d1'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:11.911331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1348/2666] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:11 2022] DELETE /identity/v3/users/71a8287f606345948f9d0fcaa40185d1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:12.172457 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:12.174095 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:12.188679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5951c3b-1d42-459f-85c9-9bd13f03f69a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:12.259723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:12.260862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:12.261140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:12.261443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] PATH_INFO: `/v3/users/9fe1a122817249d59ce515f6651f1c3e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:12.262853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe1a122817249d59ce515f6651f1c3e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:12.264838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:12.279711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:12.281658 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:12.296844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c0058-8776-4ae9-b9f5-d29e0c1e6b9c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:12.312358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:12.313358 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:12.313660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:12.314212 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] PATH_INFO: `/v3/projects/4d2d5022ccca4a32aad3313f94509fb7` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:12.315531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2d5022ccca4a32aad3313f94509fb7)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:12.317696 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:12.343321 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe1a122817249d59ce515f6651f1c3e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.353410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe1a122817249d59ce515f6651f1c3e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.365798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe1a122817249d59ce515f6651f1c3e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.366489 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe1a122817249d59ce515f6651f1c3e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.379174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2d5022ccca4a32aad3313f94509fb7', 'request_id': 'req-684c300e-e648-479a-90b7-fa89455a0898'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.388871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2d5022ccca4a32aad3313f94509fb7', 'request_id': 'req-684c300e-e648-479a-90b7-fa89455a0898'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.396741 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe1a122817249d59ce515f6651f1c3e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.397109 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2d5022ccca4a32aad3313f94509fb7', 'request_id': 'req-684c300e-e648-479a-90b7-fa89455a0898'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.409459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] The token cache is being invalidate because project 4d2d5022ccca4a32aad3313f94509fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:12.409782 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.410449 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.415055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1319/2667] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:12 2022] DELETE /identity/v3/users/9fe1a122817249d59ce515f6651f1c3e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:12.415261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1349/2668] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:12 2022] DELETE /identity/v3/projects/4d2d5022ccca4a32aad3313f94509fb7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:12.416790 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:12.419645 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:12.495589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564f161-80c2-4a4d-aa6d-05ec3383d173 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:12.500830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:12.501804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:12.502027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:12.502296 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] PATH_INFO: `/v3/users/aa9313d29df34e83bd57365635c577b5` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:12.503551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9313d29df34e83bd57365635c577b5)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:12.505766 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:12.562181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9313d29df34e83bd57365635c577b5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.571428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9313d29df34e83bd57365635c577b5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.579796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9313d29df34e83bd57365635c577b5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.580585 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9313d29df34e83bd57365635c577b5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.594999 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9313d29df34e83bd57365635c577b5'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:12.602735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1320/2669] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:12 2022] DELETE /identity/v3/users/aa9313d29df34e83bd57365635c577b5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:12.735161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:12.737071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:12.850243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c300e-e648-479a-90b7-fa89455a0898 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:12.924181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:12.925893 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:12.926213 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:12.926533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] PATH_INFO: `/v3/projects/76e08c9379ad43118a23806f1da1f18a` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:12.928508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e08c9379ad43118a23806f1da1f18a)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:12.931724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:12.998467 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.000574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.014220 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e08c9379ad43118a23806f1da1f18a', 'request_id': 'req-619a37b6-b73b-476d-848d-53cdf7100a49'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.022562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7644f-2863-4968-b82b-e0b4c94fce35 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.025055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e08c9379ad43118a23806f1da1f18a', 'request_id': 'req-619a37b6-b73b-476d-848d-53cdf7100a49'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.033369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e08c9379ad43118a23806f1da1f18a', 'request_id': 'req-619a37b6-b73b-476d-848d-53cdf7100a49'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.056956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] The token cache is being invalidate because project 76e08c9379ad43118a23806f1da1f18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:13.057428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.058401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-619a37b6-b73b-476d-848d-53cdf7100a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.060258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1350/2670] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:12 2022] DELETE /identity/v3/projects/76e08c9379ad43118a23806f1da1f18a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:13.074141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cdfb5-8dbd-46bf-bc08-202899db50d8 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.074440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cdfb5-8dbd-46bf-bc08-202899db50d8 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.074713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cdfb5-8dbd-46bf-bc08-202899db50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.106518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.107572 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.107915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.108299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] PATH_INFO: `/v3/projects/ed87a252c74940e58e172010ce8597ad` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.109661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed87a252c74940e58e172010ce8597ad)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.110408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-c03cdfb5-8dbd-46bf-bc08-202899db50d8 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:13.111626 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c03cdfb5-8dbd-46bf-bc08-202899db50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.115190 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.121984 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1351/2671] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:13.127900 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.128243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.128577 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.146967 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:13.148362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.156338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1352/2672] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:13.160585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.166078 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed87a252c74940e58e172010ce8597ad', 'request_id': 'req-e33af307-d4b7-426c-a635-b5098d24037b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.170097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ff42-a8b6-4e8f-b588-454b51a10178 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.172152 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed87a252c74940e58e172010ce8597ad', 'request_id': 'req-e33af307-d4b7-426c-a635-b5098d24037b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.181297 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed87a252c74940e58e172010ce8597ad', 'request_id': 'req-e33af307-d4b7-426c-a635-b5098d24037b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.191952 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] The token cache is being invalidate because project ed87a252c74940e58e172010ce8597ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:13.192234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.192848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e33af307-d4b7-426c-a635-b5098d24037b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:13.194459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1321/2673] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:12 2022] DELETE /identity/v3/projects/ed87a252c74940e58e172010ce8597ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:13.199252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83483f65-a2ec-48b1-b31c-d90be38d5b71 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.199544 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83483f65-a2ec-48b1-b31c-d90be38d5b71 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.199810 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83483f65-a2ec-48b1-b31c-d90be38d5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.217739 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-83483f65-a2ec-48b1-b31c-d90be38d5b71 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:13.219196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-83483f65-a2ec-48b1-b31c-d90be38d5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.229171 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.229864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.230126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.230400 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.231158 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:13.231555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.233062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.244920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1353/2674] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:13.249181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.250798 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.262670 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d02bbe-5dc0-4cc5-8bcc-8d8091c25c7e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.267352 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.267986 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.268257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.268531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.269201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.271159 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.276313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1322/2675] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:13.285309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.285680 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.285959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.296665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1354/2676] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:13.301258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.305406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:13.306660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.361819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222bc1-c733-44b4-81ae-a3734aaae95c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.366574 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.370732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.370732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.371019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1323/2677] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:13.371124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.371124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.371124 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.371837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.381750 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b72d-8b30-4725-ba6a-1fb2d84c1682 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.387627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.388301 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.388578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.388848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.389576 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:13.389880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.391590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.395404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1355/2678] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:13.399499 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.407628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1324/2679] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:24:13.408505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.414443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0066ed-070e-4832-8244-48355705d49f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.420639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cf7ed-ebde-4e18-bbd7-6fa5c310efde admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.420972 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.422080 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.422359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.422632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.423413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.425624 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.426497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.427351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.427691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.427934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.428616 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.430551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.439690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1356/2680] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:13.440724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.451580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8c5d-ab26-419b-9cd8-1f1dc29208fd admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.456388 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.457047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.458235 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.458517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.460062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.461319 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1325/2681] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:13.461651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.467612 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.477399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1357/2682] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:13.478389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.488778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2df8b-a141-4944-9a16-f8542aa48921 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.533720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bd5a0-90bf-4ed4-b0dd-fc8388e4180f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.538313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.539033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.539309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.539578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.540251 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.542144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.542716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5222b8-33d0-42e9-9195-1a4e6999bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.543709 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5222b8-33d0-42e9-9195-1a4e6999bce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.544048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5222b8-33d0-42e9-9195-1a4e6999bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.544381 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5222b8-33d0-42e9-9195-1a4e6999bce0 admin admin] PATH_INFO: `/v3/projects/3948a883f65a4f0f8954eed3f55316d1/users/c6ad894679334cffb9d47025cbd32807/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.559968 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5222b8-33d0-42e9-9195-1a4e6999bce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3948a883f65a4f0f8954eed3f55316d1, user_id=c6ad894679334cffb9d47025cbd32807, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.562609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5222b8-33d0-42e9-9195-1a4e6999bce0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.566468 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1326/2683] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:13.567674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.577348 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1358/2684] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:13 2022] PUT /identity/v3/projects/3948a883f65a4f0f8954eed3f55316d1/users/c6ad894679334cffb9d47025cbd32807/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:13.583804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065fc8-83eb-476f-a08a-76e90a5d1262 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.588081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.588366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.588636 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.614809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] MFA Rules not processed for user `c6ad894679334cffb9d47025cbd32807`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:13.616087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.644949 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.645639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.646111 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.646385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.647163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.648796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.659211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1327/2685] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:13.663100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.672892 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b51d-3b4a-49d4-8d4b-fab505226d11 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.680597 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.681402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.681768 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.682103 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.683329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.685355 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1359/2686] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:13.685513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.689789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.696496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1328/2687] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:13.700688 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.705895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f5ff0-a2bd-4100-9060-27006f351c06 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.711457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.712248 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.712371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a3d54-f99d-4475-8b42-1368d1f1bfaf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.712700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.713067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.714065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.716037 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.717849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c745ac-fc31-496f-a5ba-0ebfe0baf09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.718960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c745ac-fc31-496f-a5ba-0ebfe0baf09f admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.719349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c745ac-fc31-496f-a5ba-0ebfe0baf09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.719728 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c745ac-fc31-496f-a5ba-0ebfe0baf09f admin admin] PATH_INFO: `/v3/projects/ec193c96486d4f67890cea392f27ef77/users/e4e08828df664e3bba86ca1400993ef6/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.735621 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c745ac-fc31-496f-a5ba-0ebfe0baf09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec193c96486d4f67890cea392f27ef77, user_id=e4e08828df664e3bba86ca1400993ef6, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.738552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c745ac-fc31-496f-a5ba-0ebfe0baf09f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.744535 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1360/2688] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:13.748638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.762546 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1329/2689] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:13 2022] PUT /identity/v3/projects/ec193c96486d4f67890cea392f27ef77/users/e4e08828df664e3bba86ca1400993ef6/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:13.765406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.765700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.766002 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.793735 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] MFA Rules not processed for user `e4e08828df664e3bba86ca1400993ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:13.795222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.819495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1182ead-1a88-4408-9169-66f47c0099b6 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.858697 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1330/2690] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:13.869900 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.871218 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:13.874046 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.874742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.875042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.875315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.875993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.877910 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.901531 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1361/2691] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:13 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:13.902652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.912100 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74d39f-d528-4217-9a3c-ff4da3c72792 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.916804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.917450 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.917711 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.918057 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.918785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.920429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.931673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1362/2692] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:13.934526 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fd894-bb9e-44d5-8dd6-5193a02525a5 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.935774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.938245 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.938916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.939206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.939480 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.945160 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179016-c9c3-46cf-a237-d2c5ea734a68 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:13.947819 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.949252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.949585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:13.950439 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:13.950715 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:13.951009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] PATH_INFO: `/v3/projects/bde0497cd56948cab94a3a55e452ad23/users/d92b3658f66e4ccdb2ce7271760cc365/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:13.957861 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1331/2693] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:13.965498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde0497cd56948cab94a3a55e452ad23, user_id=d92b3658f66e4ccdb2ce7271760cc365, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:13.968153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:13.981488 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1363/2694] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:13 2022] PUT /identity/v3/projects/bde0497cd56948cab94a3a55e452ad23/users/d92b3658f66e4ccdb2ce7271760cc365/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:13.985364 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:13.997452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da770406-9311-47d8-acaf-1cb24710964b service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:14.053555 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b96a4-26ee-4d88-a8f5-b03797563479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:14.054225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b96a4-26ee-4d88-a8f5-b03797563479 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:14.054524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b96a4-26ee-4d88-a8f5-b03797563479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:14.054795 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b96a4-26ee-4d88-a8f5-b03797563479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:14.055569 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b96a4-26ee-4d88-a8f5-b03797563479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:14.057127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b96a4-26ee-4d88-a8f5-b03797563479 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:14.066803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1332/2695] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:14.071312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:14.081463 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ba64-8ccb-48ea-b870-32452e36af5d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:14.086244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:14.087154 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:14.087433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:14.087704 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] PATH_INFO: `/v3/projects/bde0497cd56948cab94a3a55e452ad23/users/d92b3658f66e4ccdb2ce7271760cc365/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:14.089676 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde0497cd56948cab94a3a55e452ad23, user_id=d92b3658f66e4ccdb2ce7271760cc365, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:14.092423 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:14.103094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1364/2696] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:14 2022] PUT /identity/v3/projects/bde0497cd56948cab94a3a55e452ad23/users/d92b3658f66e4ccdb2ce7271760cc365/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:14.113513 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:14.113800 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:14.114097 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:14.152255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] MFA Rules not processed for user `d92b3658f66e4ccdb2ce7271760cc365`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:14.153131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:14.226691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1333/2697] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:14.238228 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:14.296756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddfa3-d5ee-4ca3-aa90-52d45ab63f33 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:14.300981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051026a9-1c48-4f46-ad4e-b449ff863e9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:14.301705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051026a9-1c48-4f46-ad4e-b449ff863e9a service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:14.302084 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051026a9-1c48-4f46-ad4e-b449ff863e9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:14.302540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051026a9-1c48-4f46-ad4e-b449ff863e9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:14.313236 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051026a9-1c48-4f46-ad4e-b449ff863e9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:14.314789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051026a9-1c48-4f46-ad4e-b449ff863e9a service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:14.329048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1365/2698] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:14.749093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:14.825545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a2eda-9849-48ae-a30a-642e0f4d87a4 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:14.830758 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:14.831657 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:14.831931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:14.832311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] PATH_INFO: `/v3/users/c6ad894679334cffb9d47025cbd32807` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:14.833486 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ad894679334cffb9d47025cbd32807)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:14.835830 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:14.884665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ad894679334cffb9d47025cbd32807'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:14.892215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ad894679334cffb9d47025cbd32807'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:14.899395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ad894679334cffb9d47025cbd32807'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:14.900168 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ad894679334cffb9d47025cbd32807'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:14.912163 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ad894679334cffb9d47025cbd32807'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:14.921156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1334/2699] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:14 2022] DELETE /identity/v3/users/c6ad894679334cffb9d47025cbd32807 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:14.923429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:14.923890 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:14.924101 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:14.942857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:14.944087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:15.003833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1366/2700] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:15.015170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:15.016673 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:15.077039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cc085-2950-4b63-b5da-6ea237c69639 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:15.081651 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:15.082426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:15.082707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:15.083016 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:15.093205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:15.094630 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:15.108875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1335/2701] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:15.392860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:15.394434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:15.412165 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e9a23-2fa2-420b-90b6-97de6d52d83d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:15.417832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:15.418752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:15.419507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:15.419907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] PATH_INFO: `/v3/projects/3948a883f65a4f0f8954eed3f55316d1` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:15.421258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3948a883f65a4f0f8954eed3f55316d1)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:15.423261 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:15.471994 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3948a883f65a4f0f8954eed3f55316d1', 'request_id': 'req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.480069 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3948a883f65a4f0f8954eed3f55316d1', 'request_id': 'req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.486461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3948a883f65a4f0f8954eed3f55316d1', 'request_id': 'req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.497497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] The token cache is being invalidate because project 3948a883f65a4f0f8954eed3f55316d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:15.497778 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.498540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.500183 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1367/2702] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:15 2022] DELETE /identity/v3/projects/3948a883f65a4f0f8954eed3f55316d1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:15.504357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:15.513977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f9920-9922-4570-bf78-3e478abe376a service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:15.574332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:15.575237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:15.575565 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:15.575837 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] PATH_INFO: `/v3/users/d92b3658f66e4ccdb2ce7271760cc365` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:15.577122 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92b3658f66e4ccdb2ce7271760cc365)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:15.579093 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:15.629153 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92b3658f66e4ccdb2ce7271760cc365'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.636759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92b3658f66e4ccdb2ce7271760cc365'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.643642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92b3658f66e4ccdb2ce7271760cc365'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.644266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92b3658f66e4ccdb2ce7271760cc365'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.656626 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-199f0cc7-bd28-40a6-8740-d89abea699c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92b3658f66e4ccdb2ce7271760cc365'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:15.662953 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1336/2703] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:15 2022] DELETE /identity/v3/users/d92b3658f66e4ccdb2ce7271760cc365 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:15.940847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:15.942956 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:15.958090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34ed1-8a87-4fd3-b325-5d7fa1e0dda3 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.017417 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.018304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.018595 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.018863 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] PATH_INFO: `/v3/projects/bde0497cd56948cab94a3a55e452ad23` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.020176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde0497cd56948cab94a3a55e452ad23)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.022164 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.072009 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde0497cd56948cab94a3a55e452ad23', 'request_id': 'req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:16.080091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde0497cd56948cab94a3a55e452ad23', 'request_id': 'req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:16.086515 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde0497cd56948cab94a3a55e452ad23', 'request_id': 'req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:16.096965 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] The token cache is being invalidate because project bde0497cd56948cab94a3a55e452ad23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:16.097242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:16.097897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4cd752ca-1a25-4a1e-9ffa-71e1ac880a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:16.099785 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1368/2704] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:15 2022] DELETE /identity/v3/projects/bde0497cd56948cab94a3a55e452ad23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:16.104669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.105164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.105164 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.125298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:16.126505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:16.186956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1337/2705] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:16.196262 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.196554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.196955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.215145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:16.216328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:16.224292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1369/2706] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:16.228627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.238639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d1998-2c47-4a6c-a470-a497f76c6f71 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.243310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.243951 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.244227 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.244499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.245238 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:16.245570 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.247340 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.258964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1338/2707] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:16.263454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.272857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9799a79-5606-40fe-93d4-1346fa86a75d None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.278102 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.278741 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.279054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.279328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.280005 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.281937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.311680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1370/2708] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:16.315961 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.326587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f571f-21f7-4cbd-affc-8758000ceb40 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.386198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.386936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.387280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.387617 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.388394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.390550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.415389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1339/2709] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:16.416919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.429700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fcf7-997f-4c8a-afa0-d17e81116961 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.434797 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.435509 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.435790 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.436066 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.436871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.438413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.449063 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1371/2710] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:16.453109 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.463665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271512-3e3b-4e6b-85c6-12029c2141e3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.468524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089f542-f0f4-4bc0-9f18-51481fa2bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.469178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089f542-f0f4-4bc0-9f18-51481fa2bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.469452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089f542-f0f4-4bc0-9f18-51481fa2bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.469716 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089f542-f0f4-4bc0-9f18-51481fa2bc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.470432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089f542-f0f4-4bc0-9f18-51481fa2bc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.472036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089f542-f0f4-4bc0-9f18-51481fa2bc44 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.482023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1340/2711] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:16.486242 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.496420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5e18e-80c7-4b27-873c-e7c08b609b93 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.501123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.501990 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.502246 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.502532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] PATH_INFO: `/v3/projects/0cea1642bb574e2587679f0b2849b0dd/users/d176c5626a764626a9f8e9a1c1b4675b/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.516755 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cea1642bb574e2587679f0b2849b0dd, user_id=d176c5626a764626a9f8e9a1c1b4675b, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.519424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.534760 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1372/2712] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:16 2022] PUT /identity/v3/projects/0cea1642bb574e2587679f0b2849b0dd/users/d176c5626a764626a9f8e9a1c1b4675b/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:16.547393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.547675 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.547960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.577345 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] MFA Rules not processed for user `d176c5626a764626a9f8e9a1c1b4675b`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:16.578532 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:16.644485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1341/2713] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:16.649134 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.712197 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66dcc1-5f7a-4979-a4a3-9c2c290d958a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.717839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.718521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.718788 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.719091 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.719793 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.721719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.748817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1373/2714] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:16.752734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.764173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9b55f-62d4-4006-b90b-a1c038dfad57 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.824679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.825377 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.825650 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.825917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.826610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.828540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.850869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1342/2715] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:16 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:16.854700 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.865364 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5cac1-068f-46c2-a3bb-5cc7ac5101ca admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.870347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.871059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.871342 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.871632 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.872382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.873988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.887256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1374/2716] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:16.892533 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.903496 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6497d-5476-4c93-bc2b-8b760a7f25b5 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:16.909285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:16.910419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:16.910762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:16.911124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] PATH_INFO: `/v3/projects/1a9b98d573fb45f585d7f6b3a76eb5b6/users/683a4bac7745450699a2ea6feeb2216e/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:16.928552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b98d573fb45f585d7f6b3a76eb5b6, user_id=683a4bac7745450699a2ea6feeb2216e, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:16.931583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:16.946841 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1343/2717] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:16 2022] PUT /identity/v3/projects/1a9b98d573fb45f585d7f6b3a76eb5b6/users/683a4bac7745450699a2ea6feeb2216e/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:16.950935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:16.961868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb647c0f-ccfa-48bf-b53c-63a83d2e81b1 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:17.019126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364414a-5d54-4f85-9507-ab15775d4ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:17.019706 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364414a-5d54-4f85-9507-ab15775d4ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:17.019982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364414a-5d54-4f85-9507-ab15775d4ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:17.020266 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364414a-5d54-4f85-9507-ab15775d4ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:17.021059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364414a-5d54-4f85-9507-ab15775d4ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:17.022803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364414a-5d54-4f85-9507-ab15775d4ae1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:17.032839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1375/2718] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:17.037464 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:17.047821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d559a3-c41e-41f2-8eba-e6ef2d7ab582 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:17.052946 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:17.053865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:17.054145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:17.054414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] PATH_INFO: `/v3/projects/1a9b98d573fb45f585d7f6b3a76eb5b6/users/683a4bac7745450699a2ea6feeb2216e/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:17.056406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b98d573fb45f585d7f6b3a76eb5b6, user_id=683a4bac7745450699a2ea6feeb2216e, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:17.059059 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:17.069209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1344/2719] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:17 2022] PUT /identity/v3/projects/1a9b98d573fb45f585d7f6b3a76eb5b6/users/683a4bac7745450699a2ea6feeb2216e/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:17.079629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:17.079922 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:17.080194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:17.105664 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] MFA Rules not processed for user `683a4bac7745450699a2ea6feeb2216e`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:17.106852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:17.177750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1376/2720] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:17.189318 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:17.191203 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:17.254023 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28b8c2-f27c-4dbe-bcf1-30e2ad776a3c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:17.258106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:17.258774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:17.259088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:17.259363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:17.274047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:17.275804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:17.287334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1345/2721] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:17.374298 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:17.392611 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72272-71a4-48c8-8c69-9084ae351096 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:17.397107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654443f-c058-4872-af00-b99065356d3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:17.398021 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654443f-c058-4872-af00-b99065356d3f service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:17.398354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654443f-c058-4872-af00-b99065356d3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:17.398680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654443f-c058-4872-af00-b99065356d3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:17.467448 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654443f-c058-4872-af00-b99065356d3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:17.468985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654443f-c058-4872-af00-b99065356d3f service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:17.478143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1377/2722] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:21.243934 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:21.324196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d95c66-55e5-4522-a9d8-181d5c20ab86 service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:21.328776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:21.329709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:21.329980 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:21.330247 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] PATH_INFO: `/v3/users/d176c5626a764626a9f8e9a1c1b4675b` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:21.331462 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d176c5626a764626a9f8e9a1c1b4675b)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:21.333564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:21.383038 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd176c5626a764626a9f8e9a1c1b4675b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.390398 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd176c5626a764626a9f8e9a1c1b4675b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.397545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd176c5626a764626a9f8e9a1c1b4675b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.398180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd176c5626a764626a9f8e9a1c1b4675b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.410519 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd176c5626a764626a9f8e9a1c1b4675b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.416370 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1346/2723] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:21 2022] DELETE /identity/v3/users/d176c5626a764626a9f8e9a1c1b4675b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:21.421047 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:21.421500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:21.421597 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:21.439329 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:21.440589 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:21.500399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1378/2724] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:21.512886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:21.514368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:21.573666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14351a-8716-4098-8775-00b6c08fa2d4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:21.578648 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:21.579363 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:21.579701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:21.580090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:21.589824 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:21.591531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:21.601505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1347/2725] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:21.871304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:21.872756 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:21.884945 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d767-c066-4d70-b425-88c0880a162c None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:21.889633 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:21.890510 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:21.890779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:21.891090 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] PATH_INFO: `/v3/projects/0cea1642bb574e2587679f0b2849b0dd` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:21.892252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cea1642bb574e2587679f0b2849b0dd)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:21.894145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:21.942042 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cea1642bb574e2587679f0b2849b0dd', 'request_id': 'req-1a562548-f564-4d3c-bbf4-4d525fac97d5'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.950078 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cea1642bb574e2587679f0b2849b0dd', 'request_id': 'req-1a562548-f564-4d3c-bbf4-4d525fac97d5'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.956693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cea1642bb574e2587679f0b2849b0dd', 'request_id': 'req-1a562548-f564-4d3c-bbf4-4d525fac97d5'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.966908 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] The token cache is being invalidate because project 0cea1642bb574e2587679f0b2849b0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:21.967181 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.967817 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:21.970025 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1379/2726] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:21 2022] DELETE /identity/v3/projects/0cea1642bb574e2587679f0b2849b0dd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:21.973583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:21.983571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62429398-93cb-4df3-bb93-654e26b07a73 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.043502 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.044731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.045157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.045601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] PATH_INFO: `/v3/users/683a4bac7745450699a2ea6feeb2216e` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.046770 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=683a4bac7745450699a2ea6feeb2216e)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:22.049066 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:22.097791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683a4bac7745450699a2ea6feeb2216e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.105331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683a4bac7745450699a2ea6feeb2216e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.112003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683a4bac7745450699a2ea6feeb2216e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.112609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683a4bac7745450699a2ea6feeb2216e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.124707 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d5145b8f-77cb-48b8-86f4-294f4309bc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683a4bac7745450699a2ea6feeb2216e'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.130915 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1348/2727] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:21 2022] DELETE /identity/v3/users/683a4bac7745450699a2ea6feeb2216e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:22.449217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:22.450640 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:22.463199 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a562548-f564-4d3c-bbf4-4d525fac97d5 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.526813 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.527614 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.527884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.528145 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] PATH_INFO: `/v3/projects/1a9b98d573fb45f585d7f6b3a76eb5b6` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.529504 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9b98d573fb45f585d7f6b3a76eb5b6)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:22.531947 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:22.597258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9b98d573fb45f585d7f6b3a76eb5b6', 'request_id': 'req-a8255cb2-df01-403a-b9e3-3262a5fc5c13'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.605070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9b98d573fb45f585d7f6b3a76eb5b6', 'request_id': 'req-a8255cb2-df01-403a-b9e3-3262a5fc5c13'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.611491 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9b98d573fb45f585d7f6b3a76eb5b6', 'request_id': 'req-a8255cb2-df01-403a-b9e3-3262a5fc5c13'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.621583 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] The token cache is being invalidate because project 1a9b98d573fb45f585d7f6b3a76eb5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:22.621864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.622555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-a8255cb2-df01-403a-b9e3-3262a5fc5c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:22.624117 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1380/2728] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:22 2022] DELETE /identity/v3/projects/1a9b98d573fb45f585d7f6b3a76eb5b6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:22.629253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.629722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.630088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.648789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:22.649992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:22.710205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1349/2729] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:22.719740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.720089 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.720426 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.740114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:22.741313 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:22.749748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1381/2730] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:22.754128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:22.764325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5cd9a-0c56-485e-a1f4-6445c8852d88 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.769254 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.770019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.770324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.770624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.771427 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:22.771754 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:22.773433 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:22.785177 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1350/2731] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:22.789716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:22.799116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66764513-39a3-4892-a041-ff4cccd5103f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.804521 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.804999 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.805294 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.805533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.806333 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:22.808821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:22.843490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1382/2732] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:22 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:22.844627 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:22.854763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b1e57-da4b-4abe-bf28-86b549ede9d0 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.910981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.911674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.912156 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.912590 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.913426 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:22.915561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:22.936986 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1351/2733] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:22 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:22.951460 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:22.952690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdc4cb-725d-4f97-bd5e-7cf5707509c9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.958146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.958864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.959185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.959453 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.963844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:22.965444 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:22.979427 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1383/2734] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:22.980666 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:22.991495 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc502e-d94c-48bf-827f-435c134725bd admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:22.996729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9860485-a69a-4923-a3e4-7a566e02fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:22.997396 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860485-a69a-4923-a3e4-7a566e02fd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:22.997677 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860485-a69a-4923-a3e4-7a566e02fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:22.997981 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9860485-a69a-4923-a3e4-7a566e02fd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:22.998679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9860485-a69a-4923-a3e4-7a566e02fd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.000393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9860485-a69a-4923-a3e4-7a566e02fd3a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.011086 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1352/2735] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:23.015362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.025821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41488ab9-9f0d-4a10-8294-9b1b4781995a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.031133 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.032130 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.034143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.034420 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] PATH_INFO: `/v3/projects/7e3aaf48743e435bb2cb7d233944d2a8/users/6299d0ff61a3446d97e70de285cdf96f/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.050174 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3aaf48743e435bb2cb7d233944d2a8, user_id=6299d0ff61a3446d97e70de285cdf96f, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.053077 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.066673 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1384/2736] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:23 2022] PUT /identity/v3/projects/7e3aaf48743e435bb2cb7d233944d2a8/users/6299d0ff61a3446d97e70de285cdf96f/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:23.077269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.077559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.077920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.109124 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] MFA Rules not processed for user `6299d0ff61a3446d97e70de285cdf96f`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:23.110545 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:23.178120 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1353/2737] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:23.186995 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.261921 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488135a-f80c-432d-bf7f-be86bab0f4eb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.267585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.268642 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.269121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.269732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.270764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.272936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.312396 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1385/2738] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:23 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:23.316115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.327215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a4bd0-dde6-4a01-a0b4-f3b1482dac14 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.391084 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.391912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.392225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.392540 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.393252 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.395200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.416508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1354/2739] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:23 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:23.420555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.437274 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d3805-b9ff-48f1-9636-b248f1f25cd2 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.442759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.443520 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.443861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.444216 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.445044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.446641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.458044 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1386/2740] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:23.462253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.472198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e5d1-b4d5-4bc2-9d66-e15b248e761f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.476714 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.477610 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.477906 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.478194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] PATH_INFO: `/v3/projects/d5f044e816b141729aa20bf7cd6ac617/users/4e96dd6ae83445b49fbe18a32793abdc/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.492561 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f044e816b141729aa20bf7cd6ac617, user_id=4e96dd6ae83445b49fbe18a32793abdc, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.495253 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.511564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1355/2741] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:23 2022] PUT /identity/v3/projects/d5f044e816b141729aa20bf7cd6ac617/users/4e96dd6ae83445b49fbe18a32793abdc/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:23.515962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.525867 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371a32-0753-41d0-b042-5cf27feeae8a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.581139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a22b6-e095-4477-9bf0-88852eb6727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.581806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a22b6-e095-4477-9bf0-88852eb6727c admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.582081 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a22b6-e095-4477-9bf0-88852eb6727c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.582347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a22b6-e095-4477-9bf0-88852eb6727c admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.583194 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a22b6-e095-4477-9bf0-88852eb6727c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.584764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a22b6-e095-4477-9bf0-88852eb6727c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.597740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1387/2742] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:23.599210 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.609667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc03d54-280b-4e16-869d-783f79a40e9c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.614755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.615704 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.615991 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.616444 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] PATH_INFO: `/v3/projects/d5f044e816b141729aa20bf7cd6ac617/users/4e96dd6ae83445b49fbe18a32793abdc/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.618530 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f044e816b141729aa20bf7cd6ac617, user_id=4e96dd6ae83445b49fbe18a32793abdc, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.621258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.631820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1356/2743] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:23 2022] PUT /identity/v3/projects/d5f044e816b141729aa20bf7cd6ac617/users/4e96dd6ae83445b49fbe18a32793abdc/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:23.642757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.642987 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.643315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.669707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] MFA Rules not processed for user `4e96dd6ae83445b49fbe18a32793abdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:23.670907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:23.740254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1388/2744] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:23.751869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:23.753709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:23.814141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82353c1-4eab-4870-bfc1-a7636241af54 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:23.818032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c626e0-05ca-4577-a960-fda0b2e0fddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:23.819192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c626e0-05ca-4577-a960-fda0b2e0fddd service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:23.819477 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c626e0-05ca-4577-a960-fda0b2e0fddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:23.819756 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c626e0-05ca-4577-a960-fda0b2e0fddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:23.828955 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c626e0-05ca-4577-a960-fda0b2e0fddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:23.830411 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c626e0-05ca-4577-a960-fda0b2e0fddd service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:23.839763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1357/2745] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:23.967437 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:24.027524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e87b3-61e1-4553-aaf3-c77828c400de None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:24.032343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:24.033222 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:24.033500 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:24.033879 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] PATH_INFO: `/v3/users/6299d0ff61a3446d97e70de285cdf96f` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:24.035404 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6299d0ff61a3446d97e70de285cdf96f)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:24.037332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:24.087406 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6299d0ff61a3446d97e70de285cdf96f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.094985 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6299d0ff61a3446d97e70de285cdf96f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.101970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6299d0ff61a3446d97e70de285cdf96f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.102646 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6299d0ff61a3446d97e70de285cdf96f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.103268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6299d0ff61a3446d97e70de285cdf96f'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.121029 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1389/2746] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:23 2022] DELETE /identity/v3/users/6299d0ff61a3446d97e70de285cdf96f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:24.125265 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:24.125636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:24.125848 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:24.144752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:24.145979 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:24.204713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1358/2747] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:24.214483 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:24.216028 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:24.276585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4cf85-3659-489d-9d1a-d2519c11c419 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:24.280508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:24.281185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:24.281529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:24.281804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:24.292362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:24.293838 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:24.304339 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1390/2748] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:24.607129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:24.608229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:24.622682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea61b12-8a5c-44bc-ab01-d71b3518a08b None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:24.627437 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:24.628353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:24.628629 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:24.628935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] PATH_INFO: `/v3/projects/7e3aaf48743e435bb2cb7d233944d2a8` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:24.630246 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3aaf48743e435bb2cb7d233944d2a8)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:24.632356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:24.679668 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3aaf48743e435bb2cb7d233944d2a8', 'request_id': 'req-4c970da4-b3f0-4823-ba27-8354da1ad871'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.685782 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3aaf48743e435bb2cb7d233944d2a8', 'request_id': 'req-4c970da4-b3f0-4823-ba27-8354da1ad871'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.695311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3aaf48743e435bb2cb7d233944d2a8', 'request_id': 'req-4c970da4-b3f0-4823-ba27-8354da1ad871'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.707263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] The token cache is being invalidate because project 7e3aaf48743e435bb2cb7d233944d2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:24.707549 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.708309 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.709780 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1359/2749] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:24 2022] DELETE /identity/v3/projects/7e3aaf48743e435bb2cb7d233944d2a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:24.713667 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:24.724225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a97b2f-d4c5-4322-ac9f-98dcc9fc5b11 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:24.781563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:24.782511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:24.782852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:24.783179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] PATH_INFO: `/v3/users/4e96dd6ae83445b49fbe18a32793abdc` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:24.784372 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e96dd6ae83445b49fbe18a32793abdc)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:24.786345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:24.838258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e96dd6ae83445b49fbe18a32793abdc'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.848170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e96dd6ae83445b49fbe18a32793abdc'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.855119 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e96dd6ae83445b49fbe18a32793abdc'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.855983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e96dd6ae83445b49fbe18a32793abdc'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.857067 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-f09ae3ea-192b-48f4-abb0-e7d82dc39123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e96dd6ae83445b49fbe18a32793abdc'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:24.876001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1391/2750] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:24 2022] DELETE /identity/v3/users/4e96dd6ae83445b49fbe18a32793abdc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:25.147436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.148901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:25.163696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c970da4-b3f0-4823-ba27-8354da1ad871 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.221595 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.222459 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.222734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.223036 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] PATH_INFO: `/v3/projects/d5f044e816b141729aa20bf7cd6ac617` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.224353 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f044e816b141729aa20bf7cd6ac617)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.226236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.272212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f044e816b141729aa20bf7cd6ac617', 'request_id': 'req-160dfb2a-d4e1-45f6-810f-249ffa8df039'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:25.278346 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f044e816b141729aa20bf7cd6ac617', 'request_id': 'req-160dfb2a-d4e1-45f6-810f-249ffa8df039'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:25.288192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f044e816b141729aa20bf7cd6ac617', 'request_id': 'req-160dfb2a-d4e1-45f6-810f-249ffa8df039'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:25.299225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] The token cache is being invalidate because project d5f044e816b141729aa20bf7cd6ac617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:25.299505 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:25.300527 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-160dfb2a-d4e1-45f6-810f-249ffa8df039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:25.302228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1360/2751] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:25 2022] DELETE /identity/v3/projects/d5f044e816b141729aa20bf7cd6ac617 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:25.307584 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.307869 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.308137 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.325744 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:25.326927 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:25.397726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1392/2752] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:25.405850 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.406216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.406553 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.426004 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:25.427281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:25.436172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1361/2753] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:25.440591 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.450829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49abce9-ee00-451f-b85e-4ed071758ab5 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.456555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.457208 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.457489 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.457768 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.458530 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:25.458824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.460461 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.472254 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1393/2754] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:25.476696 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.486196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a0cc9-7b1d-4005-8c14-7d62062f2ec3 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.491917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.492550 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.492825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.493088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.493765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.495708 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.524400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1362/2755] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:25.528613 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.539095 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cffa81-08ad-47f9-839b-17a569fab1f1 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.597258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.597983 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.598263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.598528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.599277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.601184 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.627443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1394/2756] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/users => generated 305 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:25.631749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.641871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef821f-ae79-4647-acf9-84e05f64bb49 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.646365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.647046 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.647325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.647589 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.648400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.649914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.660011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1363/2757] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:25.663885 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.673953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e6c6-036a-447f-956e-cb51b3bc1ecb admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.679442 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc26f-0001-4536-873c-26d97485619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.680107 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc26f-0001-4536-873c-26d97485619e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.680380 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc26f-0001-4536-873c-26d97485619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.680677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc26f-0001-4536-873c-26d97485619e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.681436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc26f-0001-4536-873c-26d97485619e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.683094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc26f-0001-4536-873c-26d97485619e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.693497 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1395/2758] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:25.697802 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.707517 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e17f-d264-4059-a858-fe9abdf5c407 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.712880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.713862 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.714148 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.714447 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] PATH_INFO: `/v3/projects/ab443b1c038f408ea2ee19ae43a3d348/users/05b9e9506e1b4b709aecc1f88bd3a357/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.730518 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab443b1c038f408ea2ee19ae43a3d348, user_id=05b9e9506e1b4b709aecc1f88bd3a357, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.733415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.748501 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1364/2759] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:25 2022] PUT /identity/v3/projects/ab443b1c038f408ea2ee19ae43a3d348/users/05b9e9506e1b4b709aecc1f88bd3a357/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:25.759147 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.759641 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.759749 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.786950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] MFA Rules not processed for user `05b9e9506e1b4b709aecc1f88bd3a357`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:25.788205 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:25.854083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1396/2760] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:25.858440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.921959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d691cc-594b-41db-bf9e-6ddbc386bc6e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:25.928101 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:25.928796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:25.929041 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:25.929410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:25.930179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:25.932228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:25.960187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1365/2761] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:25.962684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:25.973327 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ac708-b32b-4908-af51-9185668cc85a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.040058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.040751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.041024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.041287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.041940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.043963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.065534 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1397/2762] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:25 2022] POST /identity/v3/users => generated 310 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:26.069491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:26.079947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0fd11-3fb9-44ef-9935-5b525d256b6b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.085115 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.085774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.086057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.086331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.087085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.088674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.098975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1366/2763] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:26.104524 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:26.114916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a6ab-bc3e-401e-999b-94f68db26061 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.119989 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.120849 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.121123 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.121391 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] PATH_INFO: `/v3/projects/d6dbfcb588074aafbfbc07a0eb94a0d1/users/f4e9750e21d944b3af38c46be6f6c0df/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.136132 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dbfcb588074aafbfbc07a0eb94a0d1, user_id=f4e9750e21d944b3af38c46be6f6c0df, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.138732 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.152456 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1398/2764] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:26 2022] PUT /identity/v3/projects/d6dbfcb588074aafbfbc07a0eb94a0d1/users/f4e9750e21d944b3af38c46be6f6c0df/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:26.156522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:26.166649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf967fd-d369-4e21-83e4-e300187eb501 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.225781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318eee-9839-4615-925c-bc869f452ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.226448 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318eee-9839-4615-925c-bc869f452ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.226734 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318eee-9839-4615-925c-bc869f452ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.227037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318eee-9839-4615-925c-bc869f452ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.227752 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318eee-9839-4615-925c-bc869f452ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.229336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318eee-9839-4615-925c-bc869f452ae4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.238783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1367/2765] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:26.244930 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:26.256565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67797119-16ae-45ba-89a5-b8cc32172cae admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.261365 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.262273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.262546 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.262812 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] PATH_INFO: `/v3/projects/d6dbfcb588074aafbfbc07a0eb94a0d1/users/f4e9750e21d944b3af38c46be6f6c0df/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.264787 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dbfcb588074aafbfbc07a0eb94a0d1, user_id=f4e9750e21d944b3af38c46be6f6c0df, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.267441 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.277428 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1399/2766] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:26 2022] PUT /identity/v3/projects/d6dbfcb588074aafbfbc07a0eb94a0d1/users/f4e9750e21d944b3af38c46be6f6c0df/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:26.294389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.294839 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.295212 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.325992 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] MFA Rules not processed for user `f4e9750e21d944b3af38c46be6f6c0df`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:26.327204 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:26.403784 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1368/2767] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:26.414764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:26.416615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:26.477553 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575bc0f-949f-4d06-a498-fcc697452068 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.482608 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.483297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.483559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.483823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.495071 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.496552 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.506769 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1400/2768] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:26.660646 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:26.662198 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:26.674393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158272-bd0f-42c9-966b-b7fa290e3dd8 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:26.678490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe579c-57cd-4df8-ac2a-aa4fb6901637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:26.679158 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe579c-57cd-4df8-ac2a-aa4fb6901637 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:26.679436 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe579c-57cd-4df8-ac2a-aa4fb6901637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:26.679700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe579c-57cd-4df8-ac2a-aa4fb6901637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:26.735140 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe579c-57cd-4df8-ac2a-aa4fb6901637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:26.736564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe579c-57cd-4df8-ac2a-aa4fb6901637 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:26.748414 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1369/2769] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:36.612103 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:36.613684 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:36.686006 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea083b-b221-40ea-98f2-9b8a46362054 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:36.693053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:36.693949 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:36.694227 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:36.694495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] PATH_INFO: `/v3/users/e4e08828df664e3bba86ca1400993ef6` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:36.695752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e08828df664e3bba86ca1400993ef6)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:36.697777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:36.742596 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e08828df664e3bba86ca1400993ef6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:36.750991 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e08828df664e3bba86ca1400993ef6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:36.757902 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e08828df664e3bba86ca1400993ef6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:36.758563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e08828df664e3bba86ca1400993ef6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:36.759191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e08828df664e3bba86ca1400993ef6'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:36.778332 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1401/2770] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:36 2022] DELETE /identity/v3/users/e4e08828df664e3bba86ca1400993ef6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:36.784185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:36.784670 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:36.784792 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:36.803430 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:36.804755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:36.870107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1370/2771] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:36.880055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:36.881637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:36.947269 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0554c-934c-4b3e-b360-4fcf5d4d4fa4 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:36.951804 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:36.952440 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:36.952714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:36.952981 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:36.963020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:36.964495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:36.974433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1402/2772] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:37.151429 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.153241 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.165033 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83b144-baef-4210-acb8-f8e8736f744a None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.169649 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.170524 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.170803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.171106 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] PATH_INFO: `/v3/users/05b9e9506e1b4b709aecc1f88bd3a357` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.172310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b9e9506e1b4b709aecc1f88bd3a357)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.174333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.223367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b9e9506e1b4b709aecc1f88bd3a357'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.231987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b9e9506e1b4b709aecc1f88bd3a357'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.239356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b9e9506e1b4b709aecc1f88bd3a357'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.240007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b9e9506e1b4b709aecc1f88bd3a357'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.244177 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.245587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.253270 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-97657245-f3d3-449d-9386-fab0a6acfcab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b9e9506e1b4b709aecc1f88bd3a357'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.258550 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061fb6-68ec-4fe8-a196-4c14850800fe service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.264663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1371/2773] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:37 2022] DELETE /identity/v3/users/05b9e9506e1b4b709aecc1f88bd3a357 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:37.266762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2ae82-c875-4ac2-afc6-5ab5243649d3 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.266762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2ae82-c875-4ac2-afc6-5ab5243649d3 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.266762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2ae82-c875-4ac2-afc6-5ab5243649d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.269752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.270733 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.271092 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.271859 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] PATH_INFO: `/v3/projects/ec193c96486d4f67890cea392f27ef77` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.273172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec193c96486d4f67890cea392f27ef77)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.275201 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.286804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-e8e2ae82-c875-4ac2-afc6-5ab5243649d3 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:37.287917 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-e8e2ae82-c875-4ac2-afc6-5ab5243649d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.323306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec193c96486d4f67890cea392f27ef77', 'request_id': 'req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.330625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec193c96486d4f67890cea392f27ef77', 'request_id': 'req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.336992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec193c96486d4f67890cea392f27ef77', 'request_id': 'req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.345423 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1372/2774] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:37.347571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] The token cache is being invalidate because project ec193c96486d4f67890cea392f27ef77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:37.347858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.348740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.350701 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1403/2775] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:37 2022] DELETE /identity/v3/projects/ec193c96486d4f67890cea392f27ef77 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:37.355215 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.355923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ba2e6-fd47-4406-a7ba-73cbfaadb8f4 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.356267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ba2e6-fd47-4406-a7ba-73cbfaadb8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.356558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.356663 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ba2e6-fd47-4406-a7ba-73cbfaadb8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.374347 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-a30ba2e6-fd47-4406-a7ba-73cbfaadb8f4 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:37.375552 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a30ba2e6-fd47-4406-a7ba-73cbfaadb8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.415770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398ecc3-2a87-4816-a0ba-b7ba82202b1d admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.420244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.420895 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.421170 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.421445 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.423370 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.433901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1373/2776] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:37.442358 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bea98-e189-4326-8e14-321fec08871f None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.443058 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bea98-e189-4326-8e14-321fec08871f None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.443225 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bea98-e189-4326-8e14-321fec08871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.464560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-563bea98-e189-4326-8e14-321fec08871f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:37.465831 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-563bea98-e189-4326-8e14-321fec08871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.473942 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1374/2777] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:37.477778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bea98-e189-4326-8e14-321fec08871f None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.485865 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.486419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bea98-e189-4326-8e14-321fec08871f None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.487394 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.490929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.491558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.491834 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.492100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.492803 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:37.493100 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.494664 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.496888 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1404/2778] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:37.506458 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1375/2779] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 08:24:37.510920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.520770 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c750-ac2e-483a-bca7-cc8a41e62bef service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.525827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.526473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.526750 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.527039 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] PATH_INFO: `/v3/projects` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.527939 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.529855 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.558059 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1405/2780] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:37 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:37.562523 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.573993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b9c6-975c-473b-8004-dcff0363843c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.634343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.635145 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.635415 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.635684 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] PATH_INFO: `/v3/users` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.636385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.638329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.662695 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1376/2781] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:37 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:24:37.666674 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.677354 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95264537-e826-474f-bbfe-95663b85e47e admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.682422 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.683289 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.683560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.683834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.684560 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.686315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.697287 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1406/2782] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:37.701325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.711528 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af199ce-4592-49b5-b9e2-00a79c73f35a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.716343 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.717076 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.717416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.717759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.718536 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.720215 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.730511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1377/2783] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:37.734629 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.744746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2b06f-45f5-4e27-9a42-9a7ac9bde93b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.750236 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c681a3-f193-49f6-997c-171d8ae8fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.751485 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c681a3-f193-49f6-997c-171d8ae8fdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.751897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c681a3-f193-49f6-997c-171d8ae8fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.752230 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c681a3-f193-49f6-997c-171d8ae8fdc4 admin admin] PATH_INFO: `/v3/projects/b2d74f76853942e0a583bf63e9acf838/users/83fd557d62e8480fa54ebe89fe13a01e/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.765061 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.766786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.773311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c681a3-f193-49f6-997c-171d8ae8fdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d74f76853942e0a583bf63e9acf838, user_id=83fd557d62e8480fa54ebe89fe13a01e, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.776884 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c681a3-f193-49f6-997c-171d8ae8fdc4 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.780510 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc122fcb-f111-4aef-b7c8-f76ca29295ac admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.793967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.795057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.795452 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.795729 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] PATH_INFO: `/v3/projects/ab443b1c038f408ea2ee19ae43a3d348` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.797032 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab443b1c038f408ea2ee19ae43a3d348)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.798053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1407/2784] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:37 2022] PUT /identity/v3/projects/b2d74f76853942e0a583bf63e9acf838/users/83fd557d62e8480fa54ebe89fe13a01e/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:37.799173 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.851559 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab443b1c038f408ea2ee19ae43a3d348', 'request_id': 'req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.858921 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab443b1c038f408ea2ee19ae43a3d348', 'request_id': 'req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.865789 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.866070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.866338 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.867088 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab443b1c038f408ea2ee19ae43a3d348', 'request_id': 'req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.877229 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] The token cache is being invalidate because project ab443b1c038f408ea2ee19ae43a3d348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:37.877504 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.878127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:37.880000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1378/2785] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:37 2022] DELETE /identity/v3/projects/ab443b1c038f408ea2ee19ae43a3d348 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:37.883821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.885230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.893739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] MFA Rules not processed for user `83fd557d62e8480fa54ebe89fe13a01e`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:37.895007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:37.947994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193cdc3-e215-4a0f-a1b0-860bcb8b5da2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:37.952713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:37.953584 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:37.953859 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:37.954129 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] PATH_INFO: `/v3/users/f4e9750e21d944b3af38c46be6f6c0df` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:37.955333 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e9750e21d944b3af38c46be6f6c0df)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:37.957255 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:37.959368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1408/2786] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:37.970803 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:37.972169 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:38.003765 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e9750e21d944b3af38c46be6f6c0df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.011789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e9750e21d944b3af38c46be6f6c0df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.018659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e9750e21d944b3af38c46be6f6c0df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.019351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e9750e21d944b3af38c46be6f6c0df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.028387 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bc5d0-e2de-4f9b-a657-9b6705041069 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.031089 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e9750e21d944b3af38c46be6f6c0df'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.032311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.032951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.033252 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.033519 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.035302 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:38.037010 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1379/2787] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:37 2022] DELETE /identity/v3/users/f4e9750e21d944b3af38c46be6f6c0df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:38.046382 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.048007 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79c62-93e7-4f2e-8f27-5c4c5681a1ad service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.057517 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1409/2788] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:38.304508 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.306085 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:38.374783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f476e-083d-4efd-b2a5-67f0aa7d5c81 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.379399 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.380332 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.380607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.380879 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] PATH_INFO: `/v3/projects/d6dbfcb588074aafbfbc07a0eb94a0d1` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.382027 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6dbfcb588074aafbfbc07a0eb94a0d1)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.384007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.435445 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6dbfcb588074aafbfbc07a0eb94a0d1', 'request_id': 'req-d0b34018-2cee-4715-a504-2fd445824642'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.444157 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6dbfcb588074aafbfbc07a0eb94a0d1', 'request_id': 'req-d0b34018-2cee-4715-a504-2fd445824642'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.453582 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6dbfcb588074aafbfbc07a0eb94a0d1', 'request_id': 'req-d0b34018-2cee-4715-a504-2fd445824642'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.464641 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] The token cache is being invalidate because project d6dbfcb588074aafbfbc07a0eb94a0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:38.464930 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.465558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-d0b34018-2cee-4715-a504-2fd445824642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:38.468054 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1380/2789] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:38 2022] DELETE /identity/v3/projects/d6dbfcb588074aafbfbc07a0eb94a0d1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:38.472982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.473307 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.473697 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.495293 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:38.496599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:38.564781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1410/2790] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:38.573875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.574250 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.574606 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.593898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:38.595450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:38.604205 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1381/2791] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:38.608412 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.618226 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061ea6d-ba8d-445f-9c23-71975b06034f None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.623104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.623745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.624020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.624285 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.625010 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:38.625312 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.626920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.638508 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1411/2792] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:38.642643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.652571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3ed7-936e-400c-b24e-48d1750d1eea None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.657988 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.658916 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.659226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.659491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.660179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.662478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.689865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1382/2793] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:38 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:38.694346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.704335 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5941e3-4902-4757-b160-e157fc610945 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.766245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.767247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.767628 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.767955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.769068 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.771586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.790962 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1412/2794] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:38 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:38.796820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.807856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811641b-c2bc-44c0-96a7-5fa1ff48725e admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.813355 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.814055 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.814330 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.814596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.815499 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.816927 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.827828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1383/2795] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:38.832273 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.843247 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e099ff-88ab-4043-8bb6-24070e5d7430 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.848015 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fd309-86ec-4cf8-a717-fab66ceefd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.848672 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fd309-86ec-4cf8-a717-fab66ceefd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.848951 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fd309-86ec-4cf8-a717-fab66ceefd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.849219 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fd309-86ec-4cf8-a717-fab66ceefd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.849943 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fd309-86ec-4cf8-a717-fab66ceefd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.851616 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fd309-86ec-4cf8-a717-fab66ceefd23 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.861541 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1413/2796] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:24:38.865864 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:38.875902 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbb7ec-467b-4c20-8988-37bff29234f3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:38.880560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:38.881441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.881722 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.881996 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] PATH_INFO: `/v3/projects/b4a6e7cf27c94ebb83dd8f33e8d0296d/users/70d317a974c04003af92e09f50346e43/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.897937 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a6e7cf27c94ebb83dd8f33e8d0296d, user_id=70d317a974c04003af92e09f50346e43, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:38.900774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:38.918578 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1384/2797] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:38 2022] PUT /identity/v3/projects/b4a6e7cf27c94ebb83dd8f33e8d0296d/users/70d317a974c04003af92e09f50346e43/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:38.932288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:38.932585 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:38.932917 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:38.958707 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] MFA Rules not processed for user `70d317a974c04003af92e09f50346e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:38.959923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:39.025935 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1414/2798] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:39.030701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.099587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e739f-cab5-4ef6-9275-291a6d73b350 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.106231 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.106914 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.107200 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.107469 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.108159 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.110057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.137762 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1385/2799] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:39 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:39.142185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.153714 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd3e43-6e71-482f-8f35-989dbdb52fd1 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.210655 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.211385 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.211716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.212024 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.212809 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.214726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.236150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1415/2800] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:39 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:39.240222 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.250522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568bfd1-9f9c-4841-b1dc-80ba68e34ce8 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.255838 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.256580 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.256865 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.257137 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.257944 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.259842 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.270622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1386/2801] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:39.275035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.285514 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df7ec-f09a-4b83-a408-9ac3d0240573 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.291638 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.292554 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.292806 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.293108 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] PATH_INFO: `/v3/projects/1839f1f6cdeb4f61b3fb09304f613137/users/82846671dc0a4bab9920c69ac59d4602/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.309070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1839f1f6cdeb4f61b3fb09304f613137, user_id=82846671dc0a4bab9920c69ac59d4602, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.311841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.328603 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1416/2802] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:39 2022] PUT /identity/v3/projects/1839f1f6cdeb4f61b3fb09304f613137/users/82846671dc0a4bab9920c69ac59d4602/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:39.332639 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.342732 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcfd1d-a221-490c-a975-f4d9d819b75f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.406112 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2adc4c-3272-4c5a-8762-8b126cee78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.406787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2adc4c-3272-4c5a-8762-8b126cee78b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.407128 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2adc4c-3272-4c5a-8762-8b126cee78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.407812 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2adc4c-3272-4c5a-8762-8b126cee78b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.408211 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2adc4c-3272-4c5a-8762-8b126cee78b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.409939 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2adc4c-3272-4c5a-8762-8b126cee78b2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.420213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1387/2803] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:39.424936 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.436114 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0db2b-0405-41da-8c78-688e47d8ec64 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.441669 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.442579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.442853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.443150 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] PATH_INFO: `/v3/projects/1839f1f6cdeb4f61b3fb09304f613137/users/82846671dc0a4bab9920c69ac59d4602/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.445283 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1839f1f6cdeb4f61b3fb09304f613137, user_id=82846671dc0a4bab9920c69ac59d4602, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.447982 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.458366 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1417/2804] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:39 2022] PUT /identity/v3/projects/1839f1f6cdeb4f61b3fb09304f613137/users/82846671dc0a4bab9920c69ac59d4602/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:39.469564 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.469776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.469994 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.497738 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] MFA Rules not processed for user `82846671dc0a4bab9920c69ac59d4602`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:39.499259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:39.565280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1388/2805] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:39.576542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:39.578239 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:39.639392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707f8a0-f174-4058-a2d3-fd1231e72260 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:39.643537 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c5b01-20ae-4b29-b864-871032f194fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:39.644244 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5b01-20ae-4b29-b864-871032f194fd service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:39.644588 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5b01-20ae-4b29-b864-871032f194fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:39.644875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c5b01-20ae-4b29-b864-871032f194fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:39.654853 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c5b01-20ae-4b29-b864-871032f194fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:39.656498 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c5b01-20ae-4b29-b864-871032f194fd service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:39.665781 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1418/2806] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:40.202538 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:40.270833 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736741-3ddc-40c6-866c-e28d0df681a2 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:40.276020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:40.276898 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:40.277176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:40.277558 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] PATH_INFO: `/v3/users/70d317a974c04003af92e09f50346e43` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:40.278818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d317a974c04003af92e09f50346e43)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:40.280789 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:40.331603 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d317a974c04003af92e09f50346e43'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.341434 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d317a974c04003af92e09f50346e43'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.349400 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d317a974c04003af92e09f50346e43'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.350134 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d317a974c04003af92e09f50346e43'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.366242 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d317a974c04003af92e09f50346e43'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.373568 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1389/2807] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:40 2022] DELETE /identity/v3/users/70d317a974c04003af92e09f50346e43 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:40.378260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:40.378748 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:40.379017 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:40.398161 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:40.399411 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:40.463272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1419/2808] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:40.473291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:40.474820 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:40.532357 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c023c2f-f124-4a0a-bfa3-c360f9f74b2b admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:40.536698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:40.537336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:40.537611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:40.537886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:40.547998 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:40.549764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:40.562034 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1390/2809] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:24:40.841771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:40.843260 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:40.854873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14fc48-aeab-42a5-b2b3-ad8740a5dd5a None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:40.859579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:40.860443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:40.860713 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:40.861026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] PATH_INFO: `/v3/projects/b4a6e7cf27c94ebb83dd8f33e8d0296d` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:40.862156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a6e7cf27c94ebb83dd8f33e8d0296d)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:40.864157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:40.912297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a6e7cf27c94ebb83dd8f33e8d0296d', 'request_id': 'req-b850ae24-4cf7-4b94-bf4c-529d745d02b2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.919776 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a6e7cf27c94ebb83dd8f33e8d0296d', 'request_id': 'req-b850ae24-4cf7-4b94-bf4c-529d745d02b2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.927155 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a6e7cf27c94ebb83dd8f33e8d0296d', 'request_id': 'req-b850ae24-4cf7-4b94-bf4c-529d745d02b2'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.938341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] The token cache is being invalidate because project b4a6e7cf27c94ebb83dd8f33e8d0296d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:40.938650 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.939325 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:40.940847 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1420/2810] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:40 2022] DELETE /identity/v3/projects/b4a6e7cf27c94ebb83dd8f33e8d0296d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:40.944907 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:40.954596 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02712cb-eeb8-42e1-b387-473c285908c2 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.013185 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.014057 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.014329 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.014685 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] PATH_INFO: `/v3/users/82846671dc0a4bab9920c69ac59d4602` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.015757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.015870 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82846671dc0a4bab9920c69ac59d4602)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.017115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.017757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.030187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850ae24-4cf7-4b94-bf4c-529d745d02b2 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.034807 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.035740 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.036012 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.036277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] PATH_INFO: `/v3/users/780af0cfe890480e8b69bb8ad9e492d8` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.037484 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=780af0cfe890480e8b69bb8ad9e492d8)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.039443 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.071605 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82846671dc0a4bab9920c69ac59d4602'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.080202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82846671dc0a4bab9920c69ac59d4602'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.087970 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82846671dc0a4bab9920c69ac59d4602'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.088713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82846671dc0a4bab9920c69ac59d4602'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.091435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780af0cfe890480e8b69bb8ad9e492d8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.099742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780af0cfe890480e8b69bb8ad9e492d8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.100947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-ba168051-2108-413f-8789-3ff6ad22f944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82846671dc0a4bab9920c69ac59d4602'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.106774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1391/2811] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:40 2022] DELETE /identity/v3/users/82846671dc0a4bab9920c69ac59d4602 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:41.109907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780af0cfe890480e8b69bb8ad9e492d8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.109907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780af0cfe890480e8b69bb8ad9e492d8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.109907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780af0cfe890480e8b69bb8ad9e492d8'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.125916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1421/2812] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:41 2022] DELETE /identity/v3/users/780af0cfe890480e8b69bb8ad9e492d8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:41.130409 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.130698 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.131009 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.149322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:41.150642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.209682 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1392/2813] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:41.219729 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.221507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.280878 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd648302-9464-4224-a31d-cfebf826d9fc admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.284699 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8462b-6ec7-4d1b-9b59-73ccff323484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.285401 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8462b-6ec7-4d1b-9b59-73ccff323484 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.285751 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8462b-6ec7-4d1b-9b59-73ccff323484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.286014 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8462b-6ec7-4d1b-9b59-73ccff323484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.295319 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8462b-6ec7-4d1b-9b59-73ccff323484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.296764 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8462b-6ec7-4d1b-9b59-73ccff323484 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.306677 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1422/2814] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:41.420228 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.421875 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.434308 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7145c-f548-4170-95c7-728e16ebddb0 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.439239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.440139 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.440389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.440797 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] PATH_INFO: `/v3/projects/1839f1f6cdeb4f61b3fb09304f613137` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.442217 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1839f1f6cdeb4f61b3fb09304f613137)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.444313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.492602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1839f1f6cdeb4f61b3fb09304f613137', 'request_id': 'req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.499092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1839f1f6cdeb4f61b3fb09304f613137', 'request_id': 'req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.508583 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1839f1f6cdeb4f61b3fb09304f613137', 'request_id': 'req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.521410 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] The token cache is being invalidate because project 1839f1f6cdeb4f61b3fb09304f613137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:41.521701 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.522669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-b71bedad-3369-42aa-a8d9-eaf9e636ac3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.524130 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1393/2815] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:41 2022] DELETE /identity/v3/projects/1839f1f6cdeb4f61b3fb09304f613137 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:41.529494 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.530038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.530038 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.548379 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:41.549897 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.607970 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1423/2816] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:41.616000 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a494-8fea-4494-9bba-39480525b55c None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.616287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a494-8fea-4494-9bba-39480525b55c None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.616560 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a494-8fea-4494-9bba-39480525b55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.630452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.631844 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.637947 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-1925a494-8fea-4494-9bba-39480525b55c None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:41.639291 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-1925a494-8fea-4494-9bba-39480525b55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.645256 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e466f-bc5b-4205-b6a0-9b5f0a53cd61 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.648098 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1394/2817] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:41.652428 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a494-8fea-4494-9bba-39480525b55c None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.652909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.654190 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.654292 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.654545 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] PATH_INFO: `/v3/projects/0941c59bdbd249ffb9c55466b50677df` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.656496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0941c59bdbd249ffb9c55466b50677df)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.658668 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.662788 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a494-8fea-4494-9bba-39480525b55c None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.669182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.669993 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.670285 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.670551 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] PATH_INFO: `/v3/domains` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.671313 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80097) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:41.671618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.673207 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.692912 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1395/2818] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:41.694181 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.704030 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b324-a769-4608-97ce-ca47449a129f admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.709139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0941c59bdbd249ffb9c55466b50677df', 'request_id': 'req-6977e329-2194-4271-a6c4-20061ecc536a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.718282 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0941c59bdbd249ffb9c55466b50677df', 'request_id': 'req-6977e329-2194-4271-a6c4-20061ecc536a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.724942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0941c59bdbd249ffb9c55466b50677df', 'request_id': 'req-6977e329-2194-4271-a6c4-20061ecc536a'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.736433 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] The token cache is being invalidate because project 0941c59bdbd249ffb9c55466b50677df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:41.736761 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.737475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:41.739410 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1424/2819] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:41 2022] DELETE /identity/v3/projects/0941c59bdbd249ffb9c55466b50677df => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:41.771731 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.772450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.772730 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.773003 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.773718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.775783 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.809535 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1396/2820] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:41 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:41.813680 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.815185 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:41.828373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977e329-2194-4271-a6c4-20061ecc536a admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.889179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.889873 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.890153 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.890424 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.891176 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.893162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.915964 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1425/2821] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:41 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:41.920288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.931607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceb55f-fd9c-4807-acbe-0df1e9a5713a admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.936303 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.936987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.937266 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.937534 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.938271 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.939929 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.953935 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1397/2822] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:41.955479 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:41.966533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc5594-57fd-46a9-ae0d-9f9d40f896ec admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:41.971527 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23659-7a81-4186-bdf6-5aeb71476f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:41.972203 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23659-7a81-4186-bdf6-5aeb71476f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:41.972480 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23659-7a81-4186-bdf6-5aeb71476f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:41.972771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23659-7a81-4186-bdf6-5aeb71476f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:41.973503 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23659-7a81-4186-bdf6-5aeb71476f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:41.975149 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23659-7a81-4186-bdf6-5aeb71476f61 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:41.986127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1426/2823] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:41.990354 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.000327 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a68c-b6a7-4652-89bd-e37d83fd4b0c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.004893 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.005787 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.006069 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.006356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] PATH_INFO: `/v3/projects/35e6e3c265044800ac33953607c348ce/users/76aa7054429d49efb6ce186d0b14e1ed/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.020674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e6e3c265044800ac33953607c348ce, user_id=76aa7054429d49efb6ce186d0b14e1ed, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.023334 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.038249 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1398/2824] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:41 2022] PUT /identity/v3/projects/35e6e3c265044800ac33953607c348ce/users/76aa7054429d49efb6ce186d0b14e1ed/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:42.050457 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.050771 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.051191 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.080241 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] MFA Rules not processed for user `76aa7054429d49efb6ce186d0b14e1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:42.081447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:42.152413 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1427/2825] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:42.157197 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.222311 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7504f8-e589-4dc4-b8a7-f978f3d68b84 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.228689 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.229432 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.229713 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.229987 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.231336 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.233440 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.264886 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1399/2826] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:42 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:42.266016 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.277120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9466786-e17b-45ad-9491-335d2cb43732 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.335053 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.335712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.335988 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.336259 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.336937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.338963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.362296 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1428/2827] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:42 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:42.366367 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.376660 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af259-10bf-48ed-bbaa-d9d7b8268bbf admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.381723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.382366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.382659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.382967 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.383694 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.385269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.396151 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1400/2828] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:42.400471 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.411571 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b673e01-583f-4b5c-b5a6-70932c9505f9 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.417435 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.418328 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.418609 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.418909 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] PATH_INFO: `/v3/projects/b36fbe10bd38435f96051ef7eb321756/users/b3c05c57c40941f39b2dda897dd0baaf/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.435304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36fbe10bd38435f96051ef7eb321756, user_id=b3c05c57c40941f39b2dda897dd0baaf, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.438001 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.453548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1429/2829] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:42 2022] PUT /identity/v3/projects/b36fbe10bd38435f96051ef7eb321756/users/b3c05c57c40941f39b2dda897dd0baaf/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:42.459982 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.475449 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b9af-d58d-4703-bb7f-54c94712249c admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.530919 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5e4d8-1774-4f68-98f8-27b1e11d31f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.531506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e4d8-1774-4f68-98f8-27b1e11d31f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.531778 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e4d8-1774-4f68-98f8-27b1e11d31f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.532067 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e4d8-1774-4f68-98f8-27b1e11d31f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.532774 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5e4d8-1774-4f68-98f8-27b1e11d31f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.534349 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5e4d8-1774-4f68-98f8-27b1e11d31f2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.543840 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1401/2830] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:42.550523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.561383 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efaea2-0370-4071-b736-d8ce89dd0cfa admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.566373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.567303 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] REQUEST_METHOD: `PUT` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.567578 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.567875 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] PATH_INFO: `/v3/projects/b36fbe10bd38435f96051ef7eb321756/users/b3c05c57c40941f39b2dda897dd0baaf/roles/bb155e3b668f49279f0b119fcecee2c2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.569915 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36fbe10bd38435f96051ef7eb321756, user_id=b3c05c57c40941f39b2dda897dd0baaf, role_id=bb155e3b668f49279f0b119fcecee2c2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.572580 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.585026 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1430/2831] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:42 2022] PUT /identity/v3/projects/b36fbe10bd38435f96051ef7eb321756/users/b3c05c57c40941f39b2dda897dd0baaf/roles/bb155e3b668f49279f0b119fcecee2c2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:42.595063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.595351 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.595623 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.621506 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] MFA Rules not processed for user `b3c05c57c40941f39b2dda897dd0baaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:42.622691 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:42.692257 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1402/2832] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:42.703762 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.705586 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:42.765821 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321f572-2e20-417e-b87c-07db17d4467c admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.770209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.770912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.771192 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.771458 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.782104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.783564 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.793800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1431/2833] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:42.864384 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:42.865818 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:42.877814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c2ef6-bc73-48b0-a817-d92d1da7fee5 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:42.881687 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657d5a7-dc6d-4155-8324-7d2022046767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:42.882326 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d5a7-dc6d-4155-8324-7d2022046767 service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:42.882607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d5a7-dc6d-4155-8324-7d2022046767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:42.882901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657d5a7-dc6d-4155-8324-7d2022046767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:42.942796 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657d5a7-dc6d-4155-8324-7d2022046767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:42.944259 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657d5a7-dc6d-4155-8324-7d2022046767 service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:42.953179 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1403/2834] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:43.229495 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:43.291533 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eed09e-c2ec-4297-b76c-7d35049486c9 service cinder] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:43.296322 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:43.297178 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:43.297451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:43.297719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] PATH_INFO: `/v3/users/76aa7054429d49efb6ce186d0b14e1ed` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:43.298940 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76aa7054429d49efb6ce186d0b14e1ed)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:43.301172 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:43.351507 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76aa7054429d49efb6ce186d0b14e1ed'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.361351 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76aa7054429d49efb6ce186d0b14e1ed'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.368588 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76aa7054429d49efb6ce186d0b14e1ed'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.369243 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76aa7054429d49efb6ce186d0b14e1ed'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.369852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76aa7054429d49efb6ce186d0b14e1ed'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.386690 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1432/2835] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:43 2022] DELETE /identity/v3/users/76aa7054429d49efb6ce186d0b14e1ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:43.391393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:43.391863 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:43.391963 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:43.419618 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:43.420804 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:43.481187 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1404/2836] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:43.491143 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:43.492651 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:43.553054 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a49af8-5063-4707-90e7-dcdfa4ba50c0 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:43.558113 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:43.558766 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:43.559087 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:43.559362 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:43.570569 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:43.572062 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:43.582679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1433/2837] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:43.851678 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:43.853239 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:43.866182 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fb1bb-8962-407a-8433-5eafa91a1d40 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:43.871853 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:43.872749 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:43.873013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:43.873287 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] PATH_INFO: `/v3/projects/35e6e3c265044800ac33953607c348ce` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:43.874574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e6e3c265044800ac33953607c348ce)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:43.876669 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:43.923416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e6e3c265044800ac33953607c348ce', 'request_id': 'req-0754b774-a737-4291-a495-908a44ba0885'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.930379 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e6e3c265044800ac33953607c348ce', 'request_id': 'req-0754b774-a737-4291-a495-908a44ba0885'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.939208 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e6e3c265044800ac33953607c348ce', 'request_id': 'req-0754b774-a737-4291-a495-908a44ba0885'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.949847 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] The token cache is being invalidate because project 35e6e3c265044800ac33953607c348ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:43.950127 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.950794 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:43.952383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1405/2838] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:43 2022] DELETE /identity/v3/projects/35e6e3c265044800ac33953607c348ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:43.956719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:43.966916 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7738-082a-4087-b0fc-eadac06ba106 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.026359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.027345 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.027648 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.027926 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] PATH_INFO: `/v3/users/b3c05c57c40941f39b2dda897dd0baaf` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.029263 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c05c57c40941f39b2dda897dd0baaf)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.031304 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.085451 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c05c57c40941f39b2dda897dd0baaf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.095036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c05c57c40941f39b2dda897dd0baaf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.105681 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c05c57c40941f39b2dda897dd0baaf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.106683 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c05c57c40941f39b2dda897dd0baaf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.107708 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4a322068-7785-42c3-b944-d1c2b38d7d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c05c57c40941f39b2dda897dd0baaf'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.126605 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1434/2839] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:43 2022] DELETE /identity/v3/users/b3c05c57c40941f39b2dda897dd0baaf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:44.407394 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.408965 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:44.426011 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b774-a737-4291-a495-908a44ba0885 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.485263 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.486123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.486395 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.486661 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] PATH_INFO: `/v3/projects/b36fbe10bd38435f96051ef7eb321756` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.487869 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36fbe10bd38435f96051ef7eb321756)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.489776 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.541521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36fbe10bd38435f96051ef7eb321756', 'request_id': 'req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.547607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36fbe10bd38435f96051ef7eb321756', 'request_id': 'req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.555609 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36fbe10bd38435f96051ef7eb321756', 'request_id': 'req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.566391 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] The token cache is being invalidate because project b36fbe10bd38435f96051ef7eb321756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:44.566676 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.567380 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e5f3e4ff-d6c8-4552-82fb-58f4c8863027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:44.568945 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1406/2840] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:44 2022] DELETE /identity/v3/projects/b36fbe10bd38435f96051ef7eb321756 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:24:44.573919 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.574376 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.574496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.592652 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:44.593839 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:44.654065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1435/2841] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:44.662490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.662816 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.663154 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.684113 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:44.685322 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:44.694402 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1407/2842] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:24:44.698907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.708856 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c917cf-5006-42bb-8aca-61df8363ea74 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.714209 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.714862 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.715162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.715429 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.716152 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:24:44.716454 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.718061 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.729958 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1436/2843] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:24:44.734425 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.744653 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22987876-43e6-4f6d-a206-d61be2b96315 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.750515 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.751196 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.751478 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.751748 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.752442 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.754344 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.787485 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1408/2844] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:24:44 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:44.793963 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.806923 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f297b4-5a86-47e3-8324-0b997e4e53ba admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.874206 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.875139 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.875434 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.875857 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.877157 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.878459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.900757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1437/2845] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:24:44 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:24:44.905018 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.917599 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8c631-8ddb-4e1a-bbec-bd6b9c0434b2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.925131 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.925871 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.926170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.926658 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.927484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.929224 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.943240 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1409/2846] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:44.944399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.954343 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be41bf-aa7c-426d-a83c-9bf6e51e8039 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.962693 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b3e0a-5bce-4b73-8768-37d25a4db56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.963408 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3e0a-5bce-4b73-8768-37d25a4db56e admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.963712 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3e0a-5bce-4b73-8768-37d25a4db56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.964094 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b3e0a-5bce-4b73-8768-37d25a4db56e admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:44.964777 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3e0a-5bce-4b73-8768-37d25a4db56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:44.966802 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b3e0a-5bce-4b73-8768-37d25a4db56e admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:44.977392 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1438/2847] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:24:44.981281 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:44.991407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ebdef-c6a9-4229-8ea9-5f4efedef1eb admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:44.996194 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:44.997135 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:44.997416 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:44.997703 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] PATH_INFO: `/v3/projects/655f00057d404b929902c24c43f37cb7/users/bd87acbae09f4074af2814f5a51e40ef/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:45.014421 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655f00057d404b929902c24c43f37cb7, user_id=bd87acbae09f4074af2814f5a51e40ef, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:45.017288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:45.031280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1410/2848] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:24:44 2022] PUT /identity/v3/projects/655f00057d404b929902c24c43f37cb7/users/bd87acbae09f4074af2814f5a51e40ef/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:45.097911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:45.098272 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:45.098540 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:45.130198 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] MFA Rules not processed for user `bd87acbae09f4074af2814f5a51e40ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:45.131506 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:45.206726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1439/2849] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:45.217849 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:45.219638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:45.279283 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd78d9-a473-44bd-b94b-87c63071abc4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:45.283372 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f830-3cef-49ac-a43b-94183c285dc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a8dcc7e7ecb48c7b89845bbd9babbeb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:45.284017 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f830-3cef-49ac-a43b-94183c285dc5 service glance] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:45.284298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f830-3cef-49ac-a43b-94183c285dc5 service glance] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:45.284577 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f830-3cef-49ac-a43b-94183c285dc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:45.292867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31f830-3cef-49ac-a43b-94183c285dc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:45.294290 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31f830-3cef-49ac-a43b-94183c285dc5 service glance] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:45.303466 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1411/2850] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:47.196600 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:47.198116 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:47.269477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf90f0a-f983-4e58-93c4-c4eab9b58393 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:47.273993 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:47.274868 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:47.275162 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:47.275425 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] PATH_INFO: `/v3/users/83fd557d62e8480fa54ebe89fe13a01e` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:47.276599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fd557d62e8480fa54ebe89fe13a01e)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:47.278841 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:47.326278 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fd557d62e8480fa54ebe89fe13a01e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.333660 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fd557d62e8480fa54ebe89fe13a01e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.340920 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fd557d62e8480fa54ebe89fe13a01e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.341529 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fd557d62e8480fa54ebe89fe13a01e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.342268 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fd557d62e8480fa54ebe89fe13a01e'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.361179 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1440/2851] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:24:47 2022] DELETE /identity/v3/users/83fd557d62e8480fa54ebe89fe13a01e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:47.366307 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:47.366825 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:47.367080 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:47.392049 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:24:47.393324 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:47.464174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1412/2852] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:24:47.474231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:47.475739 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:47.533719 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06802c5b-5817-401b-94d1-cd9657eb2f70 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:47.543399 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:47.544065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:47.544349 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:47.544625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:47.554657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:47.556389 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:47.566035 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1441/2853] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:47.839771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:47.839771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:47.850123 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3cecf-6c71-4505-8b3c-a5cfc36f6df7 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:47.855213 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:47.856087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:47.856366 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:47.856638 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] PATH_INFO: `/v3/projects/b2d74f76853942e0a583bf63e9acf838` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:47.857821 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d74f76853942e0a583bf63e9acf838)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:47.859764 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:47.907611 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d74f76853942e0a583bf63e9acf838', 'request_id': 'req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.917039 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d74f76853942e0a583bf63e9acf838', 'request_id': 'req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.927667 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d74f76853942e0a583bf63e9acf838', 'request_id': 'req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.938195 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] The token cache is being invalidate because project b2d74f76853942e0a583bf63e9acf838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:24:47.938479 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.939174 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:24:47.940781 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1413/2854] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:24:47 2022] DELETE /identity/v3/projects/b2d74f76853942e0a583bf63e9acf838 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:24:50.131217 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:50.132824 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:50.202686 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b355-449f-41e0-b095-346b6c0d0490 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:50.266020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b99e7835d04098ad38e4eee401ea91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:50.266717 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:50.267020 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:50.267288 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:50.269306 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:50.281810 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:50.283431 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:50.293373 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1442/2855] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:24:53.382258 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:24:53.383911 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:53.451026 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d983c-f9bc-4c2f-a1e6-9a52ec1bcce9 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:24:53.454938 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:24:53.455602 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:24:53.455844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:24:53.456143 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:24:53.458087 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:24:53.525490 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:24:53.527007 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:24:53.536441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1414/2856] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:24:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:25:00.623018 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:00.625318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:00.641834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184a281-a6d8-4bcc-8a46-1d03a0ed0cde service placement] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:00.645587 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:00.646369 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:00.646644 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:00.646942 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:00.648752 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:00.714034 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:00.715542 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:00.725459 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1443/2857] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 08:25:08.273497 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:08.275777 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:08.294170 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42133ab0-9315-41af-961a-a48a1ea4f44a service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:08.307406 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:08.310775 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:08.311138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:08.311407 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] PATH_INFO: `/v3/users/bd87acbae09f4074af2814f5a51e40ef` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:08.321298 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd87acbae09f4074af2814f5a51e40ef)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:08.326178 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:08.418236 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd87acbae09f4074af2814f5a51e40ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.440581 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd87acbae09f4074af2814f5a51e40ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.445233 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:08.447906 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:08.462255 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829973-ffa3-4dd6-9de5-b42e4449c1d6 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:08.464075 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd87acbae09f4074af2814f5a51e40ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.466715 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd87acbae09f4074af2814f5a51e40ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.470466 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:08.471555 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:08.472156 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:08.472490 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] PATH_INFO: `/v3/users/ef0437196a324c5881698cd001717b34` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:08.473941 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0437196a324c5881698cd001717b34)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:08.476579 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:08.481209 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-54f200d4-ff4e-482a-88ee-2ed3a9a714a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd87acbae09f4074af2814f5a51e40ef'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.488272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1415/2858] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:08 2022] DELETE /identity/v3/users/bd87acbae09f4074af2814f5a51e40ef => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:08.495269 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:08.495798 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:08.496063 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:08.517371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:25:08.518622 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:08.533447 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0437196a324c5881698cd001717b34'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.543341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0437196a324c5881698cd001717b34'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.552111 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0437196a324c5881698cd001717b34'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.553125 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0437196a324c5881698cd001717b34'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.554112 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0437196a324c5881698cd001717b34'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.574146 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1444/2859] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:08 2022] DELETE /identity/v3/users/ef0437196a324c5881698cd001717b34 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:25:08.586931 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1416/2860] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:25:08.598121 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:08.600141 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:08.660470 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001a30f-22f0-476f-8dcd-6c434aa8046f admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:08.665606 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:08.666281 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:08.666558 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:08.666827 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:08.738257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:08.740318 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:08.770950 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1445/2861] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:25:08.776674 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:08.778138 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:08.790924 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80188224-96f0-4f3a-9032-59ddad13c7fa None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:08.795786 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:08.796835 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:08.797180 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:08.797531 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] PATH_INFO: `/v3/projects/b207a35c92594e5e8b968a59a8509940` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:08.798975 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b207a35c92594e5e8b968a59a8509940)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:08.801541 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:08.851571 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b207a35c92594e5e8b968a59a8509940', 'request_id': 'req-a6591b77-d88d-41eb-831b-67cc21cb03a3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.858554 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b207a35c92594e5e8b968a59a8509940', 'request_id': 'req-a6591b77-d88d-41eb-831b-67cc21cb03a3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.866607 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b207a35c92594e5e8b968a59a8509940', 'request_id': 'req-a6591b77-d88d-41eb-831b-67cc21cb03a3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.878141 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] The token cache is being invalidate because project b207a35c92594e5e8b968a59a8509940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:08.878522 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.879272 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:08.881092 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1417/2862] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:08 2022] DELETE /identity/v3/projects/b207a35c92594e5e8b968a59a8509940 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:08.885532 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:08.895992 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fd0ff-ee97-492c-8dda-495e3d22edd7 service neutron] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:08.956679 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:08.957637 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:08.957913 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:08.958210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] PATH_INFO: `/v3/users/c1a0a98e9f97441e9e6d6a9acf05656c` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:08.959829 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a0a98e9f97441e9e6d6a9acf05656c)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:08.964705 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.014058 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a0a98e9f97441e9e6d6a9acf05656c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.022549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a0a98e9f97441e9e6d6a9acf05656c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.030316 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a0a98e9f97441e9e6d6a9acf05656c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.031073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a0a98e9f97441e9e6d6a9acf05656c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.031657 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a0a98e9f97441e9e6d6a9acf05656c'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.050852 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1446/2863] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:08 2022] DELETE /identity/v3/users/c1a0a98e9f97441e9e6d6a9acf05656c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:09.070588 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.072454 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:09.086474 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6591b77-d88d-41eb-831b-67cc21cb03a3 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.160288 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.161172 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.161493 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.161779 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] PATH_INFO: `/v3/projects/655f00057d404b929902c24c43f37cb7` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.163234 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655f00057d404b929902c24c43f37cb7)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.165481 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.215498 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655f00057d404b929902c24c43f37cb7', 'request_id': 'req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.222365 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655f00057d404b929902c24c43f37cb7', 'request_id': 'req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.230828 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655f00057d404b929902c24c43f37cb7', 'request_id': 'req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.237811 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.239511 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:09.242636 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] The token cache is being invalidate because project 655f00057d404b929902c24c43f37cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:09.243019 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.243679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-e649cb87-fbe3-495b-b1a9-7af8ab73dca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.249040 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1418/2864] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:09 2022] DELETE /identity/v3/projects/655f00057d404b929902c24c43f37cb7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:09.251844 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748e495-8813-4faa-9fc9-d4a626c51e28 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.252360 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748e495-8813-4faa-9fc9-d4a626c51e28 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.252815 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748e495-8813-4faa-9fc9-d4a626c51e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.253277 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ee5b-be9b-43a4-b300-0a7c5499229b admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.273507 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-3748e495-8813-4faa-9fc9-d4a626c51e28 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:25:09.274700 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-3748e495-8813-4faa-9fc9-d4a626c51e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:09.313210 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.314073 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.314361 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.314625 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] PATH_INFO: `/v3/projects/cb7e420ca5b7450b9d6fb094a5760af2` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.315832 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb7e420ca5b7450b9d6fb094a5760af2)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.317724 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.332962 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1419/2865] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:25:09.341310 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.341601 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.341880 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.360901 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.auth.core [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80097) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:25:09.362105 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:09.363953 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb7e420ca5b7450b9d6fb094a5760af2', 'request_id': 'req-00632472-05ff-49b2-9087-85efac96d5ab'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.372331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb7e420ca5b7450b9d6fb094a5760af2', 'request_id': 'req-00632472-05ff-49b2-9087-85efac96d5ab'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.378565 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb7e420ca5b7450b9d6fb094a5760af2', 'request_id': 'req-00632472-05ff-49b2-9087-85efac96d5ab'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.390330 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] The token cache is being invalidate because project cb7e420ca5b7450b9d6fb094a5760af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:09.390615 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.391833 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:09.393452 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1447/2866] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:09 2022] DELETE /identity/v3/projects/cb7e420ca5b7450b9d6fb094a5760af2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:25:09.427628 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1420/2867] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 08:25:09.432386 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.443907 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632472-05ff-49b2-9087-85efac96d5ab admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.449311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.450115 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.450482 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.450759 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] PATH_INFO: `/v3/domains` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.452245 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 08:25:09.452726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.454475 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.471933 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1448/2868] 10.222.0.59 () {58 vars in 1152 bytes} [Wed May 4 08:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 08:25:09.473624 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.484817 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db71645-b6dc-4e7a-a1e5-9a6b2ae21403 None None] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.490712 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.491491 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] REQUEST_METHOD: `POST` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.491771 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.492107 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.492867 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.494791 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.526047 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1421/2869] 10.222.0.59 () {60 vars in 1152 bytes} [Wed May 4 08:25:09 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 08:25:09.530341 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.540826 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80de2ea-5267-4c8f-a07f-1c53024d4dde admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.607870 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.608556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.609070 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.609359 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.610072 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.612368 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.635027 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1449/2870] 10.222.0.59 () {60 vars in 1143 bytes} [Wed May 4 08:25:09 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 08:25:09.639587 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.650304 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023040da-d0ae-40e9-b84c-be9766dc8011 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.654920 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.655723 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.656005 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.656280 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.657013 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.658613 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.669192 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1422/2871] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 08:25:09.673528 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.684661 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05decc-3264-4f7e-b483-852ad1ae0e37 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.690126 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3d5ad-e9c0-4c88-9f89-2a83f3236976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.690774 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d5ad-e9c0-4c88-9f89-2a83f3236976 admin admin] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.691083 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d5ad-e9c0-4c88-9f89-2a83f3236976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.691350 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3d5ad-e9c0-4c88-9f89-2a83f3236976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.692065 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d5ad-e9c0-4c88-9f89-2a83f3236976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.693726 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3d5ad-e9c0-4c88-9f89-2a83f3236976 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.703834 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1450/2872] 10.222.0.59 () {58 vars in 1121 bytes} [Wed May 4 08:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 08:25:09.708284 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.718679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920294f-e5c5-4396-9e71-6a4ecd25e0b4 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.723574 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.724484 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.724759 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.725045 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] PATH_INFO: `/v3/projects/5b08de9df66c40f797b404cc03db0bfb/users/448b8bdd791b46028a92f9d6781684db/roles/0f86d21e44a34c5c9fc395e47e3878ec` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.740216 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b08de9df66c40f797b404cc03db0bfb, user_id=448b8bdd791b46028a92f9d6781684db, role_id=0f86d21e44a34c5c9fc395e47e3878ec)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.742925 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.758368 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1423/2873] 10.222.0.59 () {60 vars in 1482 bytes} [Wed May 4 08:25:09 2022] PUT /identity/v3/projects/5b08de9df66c40f797b404cc03db0bfb/users/448b8bdd791b46028a92f9d6781684db/roles/0f86d21e44a34c5c9fc395e47e3878ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:25:09.768742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.769036 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.769309 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.797231 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] MFA Rules not processed for user `448b8bdd791b46028a92f9d6781684db`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:25:09.798549 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:09.868819 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1451/2874] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:25:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:25:09.880472 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:09.883202 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:09.942977 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d48cb1-8e71-41e1-bebc-0e82ca5f19fa admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:09.947237 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df742434fdab408581ad24749c6c9331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:09.948077 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:09.948393 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:09.948665 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:09.957856 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:09.959385 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:09.968720 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1424/2875] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:25:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:25:20.373041 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:20.374665 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:20.443955 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa384-1bab-47c0-b0ff-ff06500312c4 None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:20.449559 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:20.450473 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:20.450745 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:20.451048 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] PATH_INFO: `/v3/users/c473be73cf814903b46d7d95182c5838` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:20.452347 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c473be73cf814903b46d7d95182c5838)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:20.454301 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:20.506716 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c473be73cf814903b46d7d95182c5838'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.515767 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c473be73cf814903b46d7d95182c5838'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.522610 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c473be73cf814903b46d7d95182c5838'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.523257 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c473be73cf814903b46d7d95182c5838'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.523864 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c473be73cf814903b46d7d95182c5838'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.540911 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1452/2876] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:20 2022] DELETE /identity/v3/users/c473be73cf814903b46d7d95182c5838 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 08:25:20.724273 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:20.737142 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b3c7-59cf-4abd-b965-ea0b1993739f service cinder] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:20.793338 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:20.794230 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:20.794511 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:20.794757 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] PATH_INFO: `/v3/projects/d0ad5d350a8241adbce3fa8f9c77632c` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:20.796022 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ad5d350a8241adbce3fa8f9c77632c)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:20.797936 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:20.843679 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ad5d350a8241adbce3fa8f9c77632c', 'request_id': 'req-96bbc7c4-3203-4063-a7d7-5e1b04b61102'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.849956 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ad5d350a8241adbce3fa8f9c77632c', 'request_id': 'req-96bbc7c4-3203-4063-a7d7-5e1b04b61102'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.859221 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ad5d350a8241adbce3fa8f9c77632c', 'request_id': 'req-96bbc7c4-3203-4063-a7d7-5e1b04b61102'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.873743 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] The token cache is being invalidate because project d0ad5d350a8241adbce3fa8f9c77632c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80097) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:20.874028 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.874960 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:20.877037 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1425/2877] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:20 2022] DELETE /identity/v3/projects/d0ad5d350a8241adbce3fa8f9c77632c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:25.152120 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:25.153563 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:25.211663 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b3761-def5-493b-93bc-36b6c635fff7 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:25.271547 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:25.272225 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] REQUEST_METHOD: `GET` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:25.272496 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:25.272800 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:25.275055 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:25.339267 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:25.340728 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b957caf-8c0d-4e18-8d58-1ad580380449 service neutron] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:25.351397 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1453/2878] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:25:28.266923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:28.268431 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:28.281299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbc7c4-3203-4063-a7d7-5e1b04b61102 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:28.287709 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:28.288888 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:28.289325 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:28.289763 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] PATH_INFO: `/v3/users/448b8bdd791b46028a92f9d6781684db` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:28.291431 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448b8bdd791b46028a92f9d6781684db)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:28.293543 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:28.355964 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448b8bdd791b46028a92f9d6781684db'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:28.366419 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448b8bdd791b46028a92f9d6781684db'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:28.376443 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448b8bdd791b46028a92f9d6781684db'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:28.377755 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448b8bdd791b46028a92f9d6781684db'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:28.399094 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448b8bdd791b46028a92f9d6781684db'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:28.408267 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1426/2879] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:28 2022] DELETE /identity/v3/users/448b8bdd791b46028a92f9d6781684db => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:28.413311 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] REQUEST_METHOD: `POST` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:28.413779 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:28.413912 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:28.433861 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.auth.core [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] MFA Rules not processed for user `9f5e493603104e09ac10fad9a8d68de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 08:25:28.435104 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:28.512556 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1454/2880] 10.222.0.59 () {58 vars in 957 bytes} [Wed May 4 08:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 08:25:28.518643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:28.520435 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:28.598539 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc8c35-317d-40d3-a7ab-22d25ede06c2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:28.602389 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b8ea1e1a44ab6b6b2cd4ca5a77b04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:28.603090 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:28.603643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:28.603923 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:28.614331 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:28.616718 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:28.644877 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1427/2881] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 08:25:28.910814 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:28.912323 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:28.930860 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d75da-eb8b-4a5e-84b9-e283ffb6383b None None] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:28.937297 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:28.938258 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:28.938543 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:28.938823 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] PATH_INFO: `/v3/projects/5b08de9df66c40f797b404cc03db0bfb` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:28.941110 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b08de9df66c40f797b404cc03db0bfb)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:28.943189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:28.992758 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b08de9df66c40f797b404cc03db0bfb', 'request_id': 'req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:28.999978 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b08de9df66c40f797b404cc03db0bfb', 'request_id': 'req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:29.006523 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b08de9df66c40f797b404cc03db0bfb', 'request_id': 'req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:29.017275 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] The token cache is being invalidate because project 5b08de9df66c40f797b404cc03db0bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:29.017557 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:29.018188 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:29.019757 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1455/2882] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:28 2022] DELETE /identity/v3/projects/5b08de9df66c40f797b404cc03db0bfb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:32.130637 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:32.132176 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:32.145745 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c536-3372-4845-b612-af94e8b03476 service neutron] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:32.203356 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:32.204144 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:32.204450 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:32.204721 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] PATH_INFO: `/v3/users/599e6fd88ed348eab5de9a6330daf477` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:32.205896 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599e6fd88ed348eab5de9a6330daf477)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:32.207846 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:32.258633 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599e6fd88ed348eab5de9a6330daf477'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.266614 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599e6fd88ed348eab5de9a6330daf477'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.273814 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599e6fd88ed348eab5de9a6330daf477'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.274521 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599e6fd88ed348eab5de9a6330daf477'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.287959 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599e6fd88ed348eab5de9a6330daf477'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.293928 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1428/2883] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:32 2022] DELETE /identity/v3/users/599e6fd88ed348eab5de9a6330daf477 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:32.469202 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:32.470742 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:32.489127 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1800c6-2a6d-48c3-961e-0f7475b3c7ad admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:32.547264 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:32.548189 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:32.548465 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:32.548746 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] PATH_INFO: `/v3/projects/74c56bb918414ffe937415b180eb5944` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:32.550367 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c56bb918414ffe937415b180eb5944)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:32.552374 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:32.599346 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c56bb918414ffe937415b180eb5944', 'request_id': 'req-cc11421c-bb9b-42f3-b4ee-369dbd777377'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.608060 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c56bb918414ffe937415b180eb5944', 'request_id': 'req-cc11421c-bb9b-42f3-b4ee-369dbd777377'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.614548 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c56bb918414ffe937415b180eb5944', 'request_id': 'req-cc11421c-bb9b-42f3-b4ee-369dbd777377'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.624581 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] The token cache is being invalidate because project 74c56bb918414ffe937415b180eb5944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:32.624858 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.625536 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.627187 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1456/2884] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:32 2022] DELETE /identity/v3/projects/74c56bb918414ffe937415b180eb5944 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:32.631579 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:32.633102 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:32.646161 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25387ea7-aa5e-4293-b556-c10951aff9f2 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:32.704441 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:32.705383 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:32.705659 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:32.705932 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] PATH_INFO: `/v3/users/7a4b24b5fd3e4d0cb65aede1c52aa374` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:32.707226 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4b24b5fd3e4d0cb65aede1c52aa374)` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:32.709206 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:32.762643 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4b24b5fd3e4d0cb65aede1c52aa374'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.771068 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4b24b5fd3e4d0cb65aede1c52aa374'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.778476 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4b24b5fd3e4d0cb65aede1c52aa374'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.779256 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4b24b5fd3e4d0cb65aede1c52aa374'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.791381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.notifications [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4b24b5fd3e4d0cb65aede1c52aa374'} {{(pid=80097) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:32.797335 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1429/2885] 10.222.0.59 () {58 vars in 1223 bytes} [Wed May 4 08:25:32 2022] DELETE /identity/v3/users/7a4b24b5fd3e4d0cb65aede1c52aa374 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:25:32.977937 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Authenticating user token {{(pid=80098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:25:32.979436 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.fernet_utils [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:25:32.995405 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11421c-bb9b-42f3-b4ee-369dbd777377 admin admin] Validating token access rules against request {{(pid=80098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:25:33.056477 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5e493603104e09ac10fad9a8d68de4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '464080567f3f4194af284b80faf51856', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:25:33.057320 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:25:33.057573 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:25:33.057871 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] PATH_INFO: `/v3/projects/f421c214c71643719681d41d51ce25fa` {{(pid=80098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:25:33.059097 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f421c214c71643719681d41d51ce25fa)` {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:25:33.061118 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] RBAC: Authorization granted {{(pid=80098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:25:33.110128 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f421c214c71643719681d41d51ce25fa', 'request_id': 'req-b830a6b3-5949-4494-be8b-51d93da53c64'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:33.118049 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f421c214c71643719681d41d51ce25fa', 'request_id': 'req-b830a6b3-5949-4494-be8b-51d93da53c64'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:33.124331 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f421c214c71643719681d41d51ce25fa', 'request_id': 'req-b830a6b3-5949-4494-be8b-51d93da53c64'} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:33.135315 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] The token cache is being invalidate because project f421c214c71643719681d41d51ce25fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 08:25:33.135599 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:33.136238 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: DEBUG keystone.notifications [None req-b830a6b3-5949-4494-be8b-51d93da53c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 08:25:33.137843 dv-cinder-840289-4-iscsi devstack@keystone.service[80098]: [pid: 80098|app: 0|req: 1457/2886] 10.222.0.59 () {58 vars in 1232 bytes} [Wed May 4 08:25:32 2022] DELETE /identity/v3/projects/f421c214c71643719681d41d51ce25fa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 08:30:17.647381 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Authenticating user token {{(pid=80097) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 08:30:17.649116 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:30:17.801983 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0b87b-a310-4855-9d5d-046ac95cc120 admin admin] Validating token access rules against request {{(pid=80097) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 08:30:17.868371 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b99e7835d04098ad38e4eee401ea91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdccacd6b02847d1bb2b3cff695ee20d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80097) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 08:30:17.869020 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] REQUEST_METHOD: `GET` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 08:30:17.869299 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] SCRIPT_NAME: `/identity` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 08:30:17.869562 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80097) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 08:30:17.871461 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.fernet_utils [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80097) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 08:30:17.882642 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 08:30:17.884323 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc349d-02a7-48b5-85f0-916713519699 service placement] RBAC: Authorization granted {{(pid=80097) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 08:30:17.894171 dv-cinder-840289-4-iscsi devstack@keystone.service[80097]: [pid: 80097|app: 0|req: 1430/2887] 10.222.0.59 () {60 vars in 1365 bytes} [Wed May 4 08:30:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)